Redis Redis for PageSpeed?

BobbyWibowo · Jul 23, 2016

I was wondering.. It says that using "maxmemory-policy allkeys-lru" will make redis behaves like memcached. So does that mean you can pretty much use redis for anything else that can use memcached, such as pagespeed?

eva2000 · Jul 23, 2016

Unfortunately ngx_pagespeed doesn’t support redis cache yet only memcached cache

buik · Jul 23, 2016

Redis in Pagespeed is currently being implemented by Google's Egor Suvorov.

eva2000 · Jul 24, 2016

rikske said: ↑

Redis in Pagespeed is currently being implemented by Google's Egor Suvorov.
Click to expand...

Yeah it's on the books

JarylW · Aug 28, 2016

Support Redis as caching backend · Issue #777 · pagespeed/ngx_pagespeed · GitHub

Seems redis is slower than memcached

eva2000 · Aug 28, 2016

JarylW said: ↑

Support Redis as caching backend · Issue #777 · pagespeed/ngx_pagespeed · GitHub

Seems redis is slower than memcached
Click to expand...

yeah could be redis versions/config related so interesting to follow on for that.

buik · Aug 28, 2016

Why did team Pagespeed spend so much time to develop a caching mechanism which sort of already exists with Memcached.

In addition, it turn out that Redis is quite slower then Memcached.

They should spend time and prioritize fast-cgi-cache as written here and PageSpeed doesn’t work nicely with fastcgi-cache as being discussed here.

eva2000 · Aug 28, 2016

redis should be faster than memcached benchmarks i did just a moment ago of 4 tests via memtier benchmark for

memcached 1.4.31 TCP
memcached 1.4.31 unix socket
redis 3.2.2 TCP
redis 3.2.2 unix socket

Though it looks like it's true for unix sockets at least.

memcached TCP

Code (Text):

memtier_benchmark -P memcache_text -s 127.0.0.1 -p 11211 --random-data --data-size-range=4-204 --data-size-pattern=S --key-minimum=200 --key-maximum=400 --key-pattern=G:G --key-stddev=10 --key-median=300

Code (Text):

4         Threads
50        Connections per thread
10000     Requests per thread
Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
------------------------------------------------------------------------
Sets       18303.88          ---          ---      0.98800      2471.92
Gets      182837.70    171303.33     11534.36      0.98800     25684.87
Totals    201141.58    171303.33     11534.36      0.98800     28156.79

memcached unix socket

Code (Text):

memtier_benchmark -P memcache_text -S /var/run/memcached/memcached1.sock --random-data --data-size-range=4-204 --data-size-pattern=S --key-minimum=200 --key-maximum=400 --key-pattern=G:G --key-stddev=10 --key-median=300

Code (Text):

4         Threads
50        Connections per thread
10000     Requests per thread
Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
------------------------------------------------------------------------
Sets       35988.68          ---          ---      0.53700      4860.23
Gets      359491.30    336459.54     23031.77      0.53700     50460.64
Totals    395479.98    336459.54     23031.77      0.53700     55320.88

redis TCP

Code (Text):

memtier_benchmark -P redis -s 127.0.0.1 -p 6379 --random-data --data-size-range=4-204 --data-size-pattern=S --key-minimum=200 --key-maximum=400 --key-pattern=G:G --key-stddev=10 --key-median=300

Code (Text):

4         Threads
50        Connections per thread
10000     Requests per thread
Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
------------------------------------------------------------------------
Sets       16289.92          ---          ---      1.11700      2343.11
Gets      162720.21    161109.12      1611.09      1.11500     22405.97
Totals    179010.13    161109.12      1611.09      1.11600     24749.08

redis unix socket

Code (Text):

memtier_benchmark -P redis -S /tmp/redis.sock --random-data --data-size-range=4-204 --data-size-pattern=S --key-minimum=200 --key-maximum=400 --key-pattern=G:G --key-stddev=10 --key-median=300

Code (Text):

4         Threads
50        Connections per thread
10000     Requests per thread
Type        Ops/sec     Hits/sec   Misses/sec      Latency       KB/sec
------------------------------------------------------------------------
Sets       36754.71          ---          ---      0.47400      5286.72
Gets      367143.23    363508.14      3635.08      0.473

buik · Aug 28, 2016

eva2000 said: ↑

redis should be faster than memcached
Click to expand...

Redis clould be faster than Memcached.
Problem is Pagespeed.

Pagespeed is huge (100 MB+ in compare to 900 KB Nginx)
and Pagespeed is kind of unstable if you ask me.

But after all. Why is there any need to use Pagespeed anyway?
Almost all sites are using just 1 or 2 of the 68 Pagespeed filters.

You could do it better yourself, on an permanent basis and not with temporary filters.
For example;

Minimizing (minify) css, javascript with YUI Compressor, compress images with Kraken,
tweak small stuff and cache it completely in Redis with Redis and Nginx.

pamamolf · Aug 28, 2016

People need automation that's why

But i agree with you 100%

eva2000 · Aug 28, 2016

bassie said: ↑

Problem is Pagespeed.
Pagespeed is huge (100 MB+ in compare to 900 KB Nginx)
and Pagespeed is kind of unstable if you ask me.
Click to expand...

ngx_pagespeed as dynamic module reduces the nginx footprint somewhat
Code (Text):
ls -lah $(which nginx)
-rwxr-xr-x 1 root root 3.3M Aug 26 05:41 /usr/local/sbin/nginx
Code (Text):
  PID User     Command                         Swap      USS      PSS      RSS 

smem -tk | grep nginx: | grep -v grep
3004 root     nginx: master process /usr/        0     1.3M     6.8M    29.4M
3005 nginx    nginx: worker process              0    10.2M    17.0M    43.8M
3007 nginx    nginx: worker process              0    10.3M    17.0M    43.7M
3006 nginx    nginx: worker process              0    10.2M    17.2M    44.2M
3008 nginx    nginx: worker process              0    10.5M    17.5M    44.5M
Centmin Mod 123.09beta01 with Nginx 1.11.3 with ngx_pagespeed 1.11.33.3 compiled as a dynamic nginx module

nginx -V
nginx version: nginx/1.11.3
built by gcc 4.8.5 20150623 (Red Hat 4.8.5-4) (GCC)
built with LibreSSL 2.4.2
TLS SNI support enabled
configure arguments: --with-ld-opt='-lrt -ljemalloc -Wl,-z,relro -Wl,-rpath,/usr/local/lib' --with-cc-opt='-m64 -mtune=native -mfpmath=sse -g -O3 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2' --sbin-path=/usr/local/sbin/nginx --conf-path=/usr/local/nginx/conf/nginx.conf --with-http_stub_status_module --with-http_secure_link_module --add-module=../nginx-module-vts --with-libatomic --with-threads --with-stream=dynamic --with-stream_ssl_module --with-http_gzip_static_module --add-dynamic-module=../ngx_brotli --add-dynamic-module=../ngx_pagespeed-release-1.11.33.3-beta --with-http_sub_module --with-http_addition_module --with-http_image_filter_module=dynamic --with-http_geoip_module --with-stream_geoip_module --with-http_realip_module --add-dynamic-module=../ngx-fancyindex-0.4.0 --add-module=../ngx_cache_purge-2.3 --add-module=../ngx_devel_kit-0.3.0 --add-dynamic-module=../set-misc-nginx-module-0.31 --add-dynamic-module=../echo-nginx-module-0.60 --add-dynamic-module=../redis2-nginx-module-0.13 --add-module=../ngx_http_redis-0.3.7 --add-module=../lua-nginx-module-0.10.6 --add-dynamic-module=../memc-nginx-module-0.17 --add-dynamic-module=../srcache-nginx-module-0.31 --add-dynamic-module=../headers-more-nginx-module-0.31 --with-pcre=../pcre-8.39 --with-pcre-jit --with-http_ssl_module --with-http_v2_module --with-openssl=../libressl-2.4.2
Click to expand...

bassie said: ↑

But after all. Why is there any need to use Pagespeed anyway?
Almost all sites are using just a few of the many Pagespeed filters.

You could do it better yourself, on an permanent basis and not always that temporary with filters. For example;
Minimizing (minify) css, javascript with YUI Compressor, compress images with Kraken, tweak small stuff and cache it completely in Redis with Redis and Nginx.
Click to expand...

well it's a choice and like any choice, you make it based on your usage requirements so not everyone will use Pagespeed and they'd decide for themselves. This forum and centminmod.com use ngx_pagespeed.

Some of the benefits outlined at Nginx PageSpeed - Benefits of ngx_pagespeed | Centmin Mod Community

buik · Aug 28, 2016

eva2000 said: ↑

ngx_pagespeed as dynamic module reduces the nginx footprint
Click to expand...

For me its not about the footprint but about adding 100 MB extra software with its own bugs, problems, errors and more to debug.
And all that for just 1 or 2 small filters.

eva2000 said: ↑

well it's a choice and like any choice, you make it based on your usage requirements so not everyone will use Pagespeed and they'd decide for themselves.
Click to expand...

Sure its up to everyone.
Pagespeed is not suitable for a large corporate site. but that's my opinion.

BobbyWibowo · Aug 31, 2016

To be fair, I use lots of the filters. Including combining CSS and renaming all rewritten resource to use CDN domain. Automation is bliss.

eva2000 · Aug 31, 2016

Yeah use nearly all the filters too on this forum and centminmod.com site - theme design quirks/incompatibility permitting

JarylW · Sep 1, 2016

eva2000 said: ↑

Yeah use nearly all the filters too on this forum and centminmod.com site - theme design quirks/incompatibility permitting
Click to expand...

Yeah pagespeed is good for when you cannot optimize the html/css/images at the application level. If it can be done pre production I think it would be the 'best case' scenario but not all apps allow that.

rdan · Jan 31, 2019

eva2000 said: ↑

redis unix socket
memtier_benchmark -P redis -S /tmp/redis.sock --random-data --data-size-range=4-204 --data-size-pattern=S --key-minimum=200 --key-maximum=400 --key-pattern=G:G --key-stddev=10 --key-median=300
Click to expand...

Any idea how can I use unix socket with XenForo?
'server' => 'unix:///tmp/redis.sock',
Doesn't work for me.

Thanks!

eva2000 · Jan 31, 2019

rdan said: ↑

Any idea how can I use unix socket with XenForo?
'server' => 'unix:///tmp/redis.sock',
Doesn't work for me.

Thanks!
Click to expand...

Probably best to ask Xenforo folks to be sure

Log in / Register

Forums

Learn about Centmin Mod LEMP Stack today

Redis Redis for PageSpeed?

BobbyWibowo Active Member

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

eva2000 Administrator Staff Member

JarylW Active Member

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

pamamolf Premium Member Premium Member

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

BobbyWibowo Active Member

eva2000 Administrator Staff Member

JarylW Active Member

rdan Well-Known Member

eva2000 Administrator Staff Member

.

Log in / Register

Useful Searches

Learn about Centmin Mod LEMP Stack today

Redis Redis for PageSpeed?

BobbyWibowo Active Member

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

eva2000 Administrator Staff Member

JarylW Active Member

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

pamamolf Premium Member Premium Member

eva2000 Administrator Staff Member

buik “The best traveler is one without a camera.”

BobbyWibowo Active Member

eva2000 Administrator Staff Member

JarylW Active Member

rdan Well-Known Member

eva2000 Administrator Staff Member

.