Join the community today
Become a Member

Nginx PageSpeed Nginx Pagespeed 1.10.x betas coming

Discussion in 'Nginx, PHP-FPM & MariaDB MySQL' started by eva2000, Dec 19, 2015.

  1. pamamolf

    pamamolf Premium Member Premium Member

    3,584
    345
    83
    May 31, 2014
    Ratings:
    +667
    Local Time:
    10:12 AM
    Nginx-1.17.x
    MariaDB 10.3.x
    :(
     
  2. pamamolf

    pamamolf Premium Member Premium Member

    3,584
    345
    83
    May 31, 2014
    Ratings:
    +667
    Local Time:
    10:12 AM
    Nginx-1.17.x
    MariaDB 10.3.x
    They reply to the bug report:

    @centminmod /cc @crowell One thing I noticed is that the config file offered in https://github.com/pagespeed/ngx_pagespeed/archive/release-1.10.33.5-beta.zip differs from the tagged version (ngx_pagespeed/config at 4ec7afe5a8621a111b05ab2b42179cb623f19369 · pagespeed/ngx_pagespeed · GitHub)

    With the version offered in the zip, I'm not able to build ngx_pagespeed.so, but when I pull in the tagged version I am able to build ngx_pagespeed.so on a freshly built CentOS 6.7 OS VM.

    @centminmod Could you try what happens with the tagged version of config that I linked? I that still does not work, we need to look into this more
     
    • Informative Informative x 1
  3. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x

    ngx_pagespeed 1.10 dynamic module + nginx 1.9.11



    • ngx_pagespeed 1.10 only works on Centmin Mod 123.09beta01 and NOT 123.08stable.

    Folks at ngx_pagespeed have fixed the problem and seems ngx_pagespeed 1.10.33.5 beta now works as a dynamic nginx module on Nginx 1.9.11 :D

    For dynamically built ngx_pagespeed module with persistent config file /etc/centminmod/custom_config.inc setup for
    Code:
    NGXDYNAMIC_NGXPAGESPEED=y
    NGINX_PAGESPEED=y
    NGXPGSPEED_VER='1.10.33.5-beta'
    NGINX_PAGESPEEDPSOL_VER='1.10.33.5'
    Then remove older broken tar ball and directory for ngx_pagespeed 1.10.33.5 beta
    Code:
    rm -rf /svr-setup/release-1.10.33.5-beta.tar.gz
    rm -rf /svr-setup/ngx_pagespeed-release-1.10.33.5-beta
    
    Then run centmin.sh menu option 4 to recompile Nginx 1.9.11
    Code:
    --------------------------------------------------------
    Centmin Mod 1.2.3-eva2000.09 - http://centminmod.com
    --------------------------------------------------------
                       Centmin Mod Menu                
    --------------------------------------------------------
    1).  Centmin Install
    2).  Add Nginx vhost domain
    3).  NSD setup domain name DNS
    4).  Nginx Upgrade / Downgrade
    5).  PHP Upgrade / Downgrade
    6).  XCache Re-install
    7).  APC Cache Re-install
    8).  XCache Install
    9).  APC Cache Install
    10). Memcached Server Re-install
    11). MariaDB 5.2/5.5 & 10.x Upgrade Sub-Menu
    12). Zend OpCache Install/Re-install
    13). Install ioping.sh vbtechsupport.com/1239/
    14). SELinux disable
    15). Install/Reinstall ImagicK PHP Extension
    16). Change SSHD Port Number
    17). Multi-thread compression: pigz,pbzip2,lbzip2...
    18). Suhosin PHP Extension install
    19). Install FFMPEG and FFMPEG PHP Extension
    20). NSD Re-install
    21). Update - Nginx + PHP-FPM + Siege
    22). Add Wordpress Nginx vhost + Cache Plugin
    23). Update Centmin Mod Code Base
    24). Exit
    --------------------------------------------------------
    Enter option [ 1 - 24 ] 4
    --------------------------------------------------------
    Part of the configure stage of Nginx 1.9.11 compilation
    Code:
    configuring additional modules
    adding module in ../nginx-module-vts
    + ngx_http_vhost_traffic_status_module was configured
    adding module in ../nginx-accesskey-2.0.3
    + ngx_http_accesskey_module was configured
    adding module in ../nginx-http-concat-master
    + ngx_http_concat_module was configured
    adding module in ../ngx-fancyindex-0.3.6
    + ngx_http_fancyindex_module was configured
    adding module in ../ngx_cache_purge-2.3
    + ngx_http_cache_purge_module was configured
    adding module in ../ngx_devel_kit-0.2.19
    + ngx_devel_kit was configured
    adding module in ../set-misc-nginx-module-0.29
    found ngx_devel_kit for ngx_set_misc; looks good.
    + ngx_http_set_misc_module was configured
    adding module in ../echo-nginx-module-0.58
    + ngx_http_echo_module was configured
    adding module in ../redis2-nginx-module-0.12
    + ngx_http_redis2_module was configured
    adding module in ../ngx_http_redis-0.3.7
    + ngx_http_redis_module was configured
    adding module in ../nginx_upstream_check_module-0.3.0
    checking for ngx_http_upstream_check_module ... found
    + ngx_http_upstream_check_module was configured
    adding module in ../openresty-memc-nginx-module-4f6f78f
    + ngx_http_memc_module was configured
    adding module in ../openresty-srcache-nginx-module-ffa9ab7
    + ngx_http_srcache_filter_module was configured
    adding module in ../headers-more-nginx-module-0.29
    + ngx_http_headers_more_filter_module was configured
    configuring additional dynamic modules
    adding module in ../ngx_pagespeed-release-1.10.33.5-beta
    mod_pagespeed_dir=../ngx_pagespeed-release-1.10.33.5-beta/psol/include
    build_from_source=false
    checking for psol ... found
    List of modules (in reverse order of applicability):  ngx_http_write_filter_module ngx_http_header_filter_module ngx_http_chunked_filter_module ngx_http_v2_filter_module ngx_http_range_header_filter_module ngx_http_gzip_filter_module ngx_http_postpone_filter_module ngx_http_ssi_filter_module ngx_http_charset_filter_module ngx_http_sub_filter_module ngx_http_addition_filter_module ngx_http_userid_filter_module ngx_http_headers_filter_module
    checking for psol-compiler-compat ... found
    + ngx_pagespeed was configured
    On CentOS 7.2, Centmin Mod 123.09beta01 auto switches back from Clang to GCC compiler for ngx_pagespeed 1.10 branch compatibility.
    dynamic modules listing
    Code:
    dynamic module directory at /usr/local/nginx/modules
    total 18M
    drwxr-xr-x  2 root root 4.0K Feb 18 17:02 .
    drwxr-xr-x 10 root root 4.0K Feb 18 03:49 ..
    -rwxr-xr-x  1 root root 122K Feb 18 17:02 ngx_http_geoip_module.so
    -rwxr-xr-x  1 root root 142K Feb 18 17:02 ngx_http_image_filter_module.so
    -rwxr-xr-x  1 root root  17M Feb 18 17:02 ngx_pagespeed.so
    -rwxr-xr-x  1 root root 545K Feb 18 17:02 ngx_stream_module.so
    Enable ngx_pagespeed as per instructions at centminmod.com/nginx_ngx_pagespeed.html

    and check headers via curl
    Code:
    curl -sI localhost | grep X-Page-Speed
    X-Page-Speed: 1.10.33.5-0
     
  4. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
    Looks like ngx_pagespeed 1.10.33.6 beta is out Google Groups

     
  5. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    Continuing my issue from Nginx - [nginx-announce] nginx-1.9.12 | Page 4 | Centmin Mod Community
    I just tried to flush Memcached. Also then tried to F5 on my forums while viewing its source. I could see that css files were being overwritten on each refresh, but the "x-page-speed" header stays the same. So, unless browser has different cache for header, then I don't think it was browser's cache issue. I also tried to use curl -sI on ssh, same header.
     
  6. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
    check centmin.sh version number is correct if you didn't specify in /etc/centminmod/custom_config.inc
    Code:
    NGINX_PAGESPEED='y' # nginx page speed
    NGXDYNAMIC_NGXPAGESPEED='y' # nginx dynamic page speed
    NGXPGSPEED_VER='1.10.33.6-beta'
    NGINX_PAGESPEEDPSOL_VER='1.10.33.6'
    only other reason is that your nginx upgrade actually failed to complete successfully, so still on older version ?
     
  7. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    Shouldn't be. My nginx was previously 1.9.12 as well, but it was compiled with OpenSSL instead. I simply recompiled it with LibreSSL and updated ngx_pagespeed (yes, I've set the version specifically in custom_config.inc). As you can see on the previous thread, nginx -V says that it was compiled with LibreSSL and used 1.10.33.6-beta.

    Here's my custom_config.inc
    Code:
    LIBRESSL_SWITCH=y
    NGINX_LIBBROTLI=y
    NGXDYNAMIC_NGXPAGESPEED=y
    NGINX_PAGESPEED=y
    NGINX_PAGESPEEDGITMASTER=y
    NGXPGSPEED_VER='1.10.33.6-beta'
    NGINX_PAGESPEEDSOL_VER='1.10.33.6'
    Should I include nginx upgrade logs? It's roughly 1.4 MB though.
    Here's the last bit:
    Code:
    ... stripped ...
    Fri Mar  4 12:45:58 UTC 2016
    Success: Nginx make ok
    
                _   _         _                __  __         _        
               | \ | |  __ _ (_) _ __  __  __ |  \/  |  __ _ | | __ ___ 
               |  \| | / _` || || '_ \ \ \/ / | |\/| | / _` || |/ // _ \
               | |\  || (_| || || | | | >  <  | |  | || (_| ||   <|  __/
               |_| \_| \__, ||_||_| |_|/_/\_\ |_|  |_| \__,_||_|\_\\___|
                       |___/                                            
                            ___              _          _  _ 
                           |_ _| _ __   ___ | |_  __ _ | || |
                            | | | '_ \ / __|| __|/ _` || || |
                            | | | | | |\__ \| |_| (_| || || |
                           |___||_| |_||___/ \__|\__,_||_||_|
                                                             
    make -f objs/Makefile install
    make[1]: Entering directory `/svr-setup/nginx-1.9.12'
    test -d '/usr/local/nginx' || mkdir -p '/usr/local/nginx'
    test -d '/usr/local/sbin'         || mkdir -p '/usr/local/sbin'
    test ! -f '/usr/local/sbin/nginx'         || mv '/usr/local/sbin/nginx'             '/usr/local/sbin/nginx.old'
    cp objs/nginx '/usr/local/sbin/nginx'
    test -d '/usr/local/nginx/conf'         || mkdir -p '/usr/local/nginx/conf'
    cp conf/koi-win '/usr/local/nginx/conf'
    cp conf/koi-utf '/usr/local/nginx/conf'
    cp conf/win-utf '/usr/local/nginx/conf'
    test -f '/usr/local/nginx/conf/mime.types'         || cp conf/mime.types '/usr/local/nginx/conf'
    cp conf/mime.types '/usr/local/nginx/conf/mime.types.default'
    test -f '/usr/local/nginx/conf/fastcgi_params'         || cp conf/fastcgi_params '/usr/local/nginx/conf'
    cp conf/fastcgi_params         '/usr/local/nginx/conf/fastcgi_params.default'
    test -f '/usr/local/nginx/conf/fastcgi.conf'         || cp conf/fastcgi.conf '/usr/local/nginx/conf'
    cp conf/fastcgi.conf '/usr/local/nginx/conf/fastcgi.conf.default'
    test -f '/usr/local/nginx/conf/uwsgi_params'         || cp conf/uwsgi_params '/usr/local/nginx/conf'
    cp conf/uwsgi_params         '/usr/local/nginx/conf/uwsgi_params.default'
    test -f '/usr/local/nginx/conf/scgi_params'         || cp conf/scgi_params '/usr/local/nginx/conf'
    cp conf/scgi_params         '/usr/local/nginx/conf/scgi_params.default'
    test -f '/usr/local/nginx/conf/nginx.conf'         || cp conf/nginx.conf '/usr/local/nginx/conf/nginx.conf'
    cp conf/nginx.conf '/usr/local/nginx/conf/nginx.conf.default'
    test -d '/usr/local/nginx/logs'         || mkdir -p '/usr/local/nginx/logs'
    test -d '/usr/local/nginx/logs' ||         mkdir -p '/usr/local/nginx/logs'
    test -d '/usr/local/nginx/html'         || cp -R html '/usr/local/nginx'
    test -d '/usr/local/nginx/logs' ||         mkdir -p '/usr/local/nginx/logs'
    test -d '/usr/local/nginx/modules'         || mkdir -p '/usr/local/nginx/modules'
    cp  objs/ngx_http_image_filter_module.so objs/ngx_http_geoip_module.so objs/ngx_pagespeed.so objs/ngx_stream_module.so '/usr/local/nginx/modules'
    make[1]: Leaving directory `/svr-setup/nginx-1.9.12'
    
    real    0m0.153s
    user    0m0.033s
    sys    0m0.047s
    
    Fri Mar  4 12:46:01 UTC 2016
    Success: Nginx was installed properly
    
    /usr/local/nginx/conf/conf.d/endlesshorizon.net.conf
    ---
    /usr/local/nginx/conf/conf.d/endlesshorizon.net.ssl.conf
    ---
    7:  listen 443 ssl http2;
    29:  listen 443 ssl http2;
    /usr/local/nginx/conf/conf.d/forums.endlesshorizon.net.conf
    ---
    /usr/local/nginx/conf/conf.d/forums.endlesshorizon.net.ssl.conf
    ---
    7:  listen 443 ssl http2;
    29:  listen 443 ssl http2;
    /usr/local/nginx/conf/conf.d/ssl.conf
    ---
    /usr/local/nginx/conf/conf.d/virtual.conf
    ---
    Starting nginx (via systemctl):  [  OK  ]
       _   _         _                 ____  _                                  
      | \ | |  __ _ (_) _ __  __  __  / ___|| |  ___   __ _  _ __   _   _  _ __  
      |  \| | / _` || || '_ \ \ \/ / | |    | | / _ \ / _` || '_ \ | | | || '_ \ 
      | |\  || (_| || || | | | >  <  | |___ | ||  __/| (_| || | | || |_| || |_) |
      |_| \_| \__, ||_||_| |_|/_/\_\  \____||_| \___| \__,_||_| |_| \__,_|| .__/ 
              |___/                                                       |_|    
    /svr-setup/ngx_pagespeed-release-1.10.33.5-beta
    /svr-setup/openssl-1.0.2f.tar.gz
    /svr-setup/openssl-1.0.2f
    
    dynamic module directory at /usr/local/nginx/modules
    total 18M
    drwxr-xr-x  2 root root 4.0K Feb 25 01:24 .
    drwxr-xr-x 11 root root 4.0K Feb 12 09:56 ..
    -rwxr-xr-x  1 root root 122K Mar  4 12:46 ngx_http_geoip_module.so
    -rwxr-xr-x  1 root root 142K Mar  4 12:46 ngx_http_image_filter_module.so
    -rwxr-xr-x  1 root root  17M Mar  4 12:46 ngx_pagespeed.so
    -rwxr-xr-x  1 root root 550K Mar  4 12:46 ngx_stream_module.so
    
    *************************************************
    * nginx updated
    *************************************************
       _   _         _                _   _             _         _             _ 
      | \ | |  __ _ (_) _ __  __  __ | | | | _ __    __| |  __ _ | |_  ___   __| |
      |  \| | / _` || || '_ \ \ \/ / | | | || '_ \  / _` | / _` || __|/ _ \ / _` |
      | |\  || (_| || || | | | >  <  | |_| || |_) || (_| || (_| || |_|  __/| (_| |
      |_| \_| \__, ||_||_| |_|/_/\_\  \___/ | .__/  \__,_| \__,_| \__|\___| \__,_|
              |___/                         |_|                                  
    
    
    Total Nginx Upgrade Time: 549.839696868 seconds
     
  8. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
    looks good for last part of nginx upgrade log

    seems you're behind cloudflare so probably cached there ?
     
  9. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    That's a possibility. But I'd guess CloudFlare would cache the raw page along with its header. Meaning, they wouldn't separate cache of headers and the raw page. If they're indeed caching them at the same time, then that doesn't connect with the issue I'm having. After the Memcached flush, PageSpeed lost its cache. So XenForo's CSS file will fallback temporarily to its original css.php?..blabla-nonsense files instead of the post-processed ones by PageSpeed. So I tried to view my forums' source while refreshing it to see every changes. It took 2 refreshes: Initially was still using css.php?..blabla-nonsense > processed by bdCache as static files > bdCache static files then combined by PageSpeed. Even after the last refresh, "x-page-speed" header still stayed as 1.10.33.5.
     
  10. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
    Just updated forums to ngx_pagespeed 1.10.33.6 beta with 123.09beta01 Centmin Mod branch with Nginx 1.9.12 and ngx-brotli enabled without problem. Shows correct version here
    Code (Text):
    curl -sI https://community.centminmod.com/ | grep X-Page-Speed
    X-Page-Speed: 1.10.33.6-0

    persistent config setup with /etc/centminmod/custom_config.inc
    Code (Text):
    NGINX_LIBBROTLI=y
    NGXDYNAMIC_NGXPAGESPEED=y
    NGINX_PAGESPEED=y
    NGXPGSPEED_VER='1.10.33.6-beta'
    NGINX_PAGESPEEDPSOL_VER='1.10.33.6'

    dynamically loaded nginx modules including ngx_pagespeed in /usr/local/nginx/conf/dynamic-modules.conf include file
    Code (Text):
    load_module "modules/ngx_http_image_filter_module.so";
    load_module "modules/ngx_pagespeed.so";
    load_module "modules/ngx_http_geoip_module.so";
    load_module "modules/ngx_stream_module.so";

     
  11. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    Less likely, but maybe issue with LibreSSL? :eek:
     
  12. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
  13. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    I rebuilt nginx again. The rebuild went just fine, but x-page-speed header was still set to .5. I'll try to rebuild nginx with OpenSSL.
     
  14. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    Update. Just finished rebuilding with OpenSSL. Same result, header is still using .5. This is weird as hell.
     
  15. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
    maybe you downloaded an earlier not yet read version ? you can remove the download sources from /svr-setup and recompile nginx and let it pull latest downloaded source
    Code (Text):
    rm -rf /svr-setup/release-1.10.33.6-beta*
    rm -rf /svr-setup/ngx_pagespeed-release-1.10.33.6-beta*
     
  16. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    Seems like it was because I build nginx before I pulled this commit: Beta Branch - update ngx_pagespeed 1.10.33.6 beta for 123.09beta01 | Centmin Mod Community
    I've just updated centmin then restored custom_config.inc to use LibreSSL.
    Forums is now using 1.10.33.6 as "x-page-speed" header o_O
     
    • Like Like x 1
  17. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
    ah ha ! (y)
     
  18. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
  19. BobbyWibowo

    BobbyWibowo Active Member

    178
    39
    28
    Jul 30, 2015
    Indonesia
    Ratings:
    +62
    Local Time:
    3:12 PM
    1.17.x
    10.1.x
    I already switched to 1.10.33.7 not so long after they released that version. But there was no commit for that version yet, so the header issue that I had before happened again, lol. Also, what about 1.11.3.0?
     
  20. eva2000

    eva2000 Administrator Staff Member

    42,383
    9,570
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +14,750
    Local Time:
    6:12 PM
    Nginx 1.17.x
    MariaDB 5.5/10.x
    haven't looked into that.. if it's not officially announced in ngx_pagespeed google group mailing list, it's not official release yet