WebPerf PageSpeed Wordpress Webpagetest PageSpeed Comparison for CyberPanel OpenLiteSpeed vs Centmin Mod LEMP

Thought I'd do some Wordpress centric Webpagetest.org PageSpeed comparison tests using my new gitools.sh script. I setup 2x CentOS 7.5 64bit 1GB, 1 cpu KVM VPS on Upcloud.com Chicago, USA. Both servers use identical cpu - Intel Xeon E5-2687w v4 at 3.00Ghz

Code (Text):

cat /proc/cpuinfo
processor       : 0
vendor_id       : GenuineIntel
cpu family      : 6
model           : 79
model name      : Intel(R) Xeon(R) CPU E5-2687W v4 @ 3.00GHz
stepping        : 1
microcode       : 0x1
cpu MHz         : 2999.996
cache size      : 16384 KB
physical id     : 0
siblings        : 1
core id         : 0
cpu cores       : 1
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl xtopology eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat
bogomips        : 5999.99
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management:

Then installed CyberPanel 1.6.4 with OpenLiteSpeed 1.4.34, PHP 7.2.5, MariaDB 10.0.35 via command

Code (Text):

yum -y update;
reboot;
time sh <(curl https://cyberpanel.net/install.sh || wget -O - https://cyberpanel.net/install.sh)

Then installed Centmin Mod 123.09beta01 via PHP 7.2 installer for Nginx 1.15.1, PHP-FPM 7.2.7, MariaDB 10.1.34 via command

Code (Text):

yum -y update;
reboot;
curl -O https://centminmod.com/betainstaller72.sh && chmod 0700 betainstaller72.sh && bash betainstaller72.sh

• Then I created a HTTPS web site and installed wordpress + lscache with the native CyberPanel installer with letsencrypt ssl certificate and created Wordpress install for Centmin Mod via centmin.sh menu option 22 wordpress installer defaulting to KeyCDN Cache Enabler plugin and installed autoptimize wp plugin.
• Then I installed OceanWP theme and demo installer plugins to install Coach OceanWP theme Coach – WordPress Demo created with OceanWP

OceanWP Coach Theme

Post Install Stats

CyberPanel

Code (Text):

free -m
              total        used        free      shared  buff/cache   available
Mem:            991         389         177          26         424         404
Swap:             0           0           0

Code (Text):

df -hT
Filesystem     Type      Size  Used Avail Use% Mounted on
/dev/vda1      xfs        25G  3.7G   22G  15% /
devtmpfs       devtmpfs  486M     0  486M   0% /dev
tmpfs          tmpfs     496M   24K  496M   1% /dev/shm
tmpfs          tmpfs     496M  6.7M  490M   2% /run
tmpfs          tmpfs     496M     0  496M   0% /sys/fs/cgroup
tmpfs          tmpfs     100M     0  100M   0% /run/user/0

Code (Text):

php -v
PHP 7.2.5 (cli) (built: Apr 27 2018 17:00:22) ( NTS )
Copyright (c) 1997-2018 The PHP Group
Zend Engine v3.2.0, Copyright (c) 1998-2018 Zend Technologies
    with Zend OPcache v7.2.5, Copyright (c) 1999-2018, by Zend Technologies

Code (Text):

/usr/local/lsws/bin/openlitespeed -v
LiteSpeed/1.4.34 Open
        module versions:
        modpagespeed 2.1-1.11.33.4
        cache 1.57
        modinspector 1.1
        uploadprogress 1.1
        mod_security 1.1

Centmin Mod

Code (Text):

free -m
              total        used        free      shared  buff/cache   available
Mem:            991         245         124          32         621         433
Swap:          1023          15        1008

Code (Text):

df -hT
Filesystem     Type      Size  Used Avail Use% Mounted on
/dev/vda1      xfs        25G  6.7G   19G  27% /
devtmpfs       devtmpfs  486M     0  486M   0% /dev
tmpfs          tmpfs     496M     0  496M   0% /dev/shm
tmpfs          tmpfs     496M  6.7M  490M   2% /run
tmpfs          tmpfs     496M     0  496M   0% /sys/fs/cgroup
tmpfs          tmpfs     100M     0  100M   0% /run/user/0
/dev/loop0     ext4      5.8G   25M  5.5G   1% /tmp

Code (Text):

PHP 7.2.7 (cli) (built: Jul 10 2018 05:41:23) ( NTS )
Copyright (c) 1997-2018 The PHP Group
Zend Engine v3.2.0, Copyright (c) 1998-2018 Zend Technologies
    with Zend OPcache v7.2.7, Copyright (c) 1999-2018, by Zend Technologies

Webpagetest.org Chrome Dulles, Cable 5Mbps

Ran 2x test back to back for each then ran 3rd test 10 minutes later so to see 1st view, 2nd cached view and 3rd cached view page speed performance. All tests were ran against the exact same WPT Dulles test server for best comparisons.

Webpagetest Filmstrip

Full strip



Cropped and split into 2 halves film strips

As you can see for 2nd and 3rd runs, Centmin Mod Nginx based Wordpress 4.9.7 with KeyCDN Cache Enabler visual rendering speed was faster than CyberPanel/OpenLightSpeed based Wordpress with LSCache. The Speedindex and First Contentful Paint metrics also back up what you can visually see in WPT filmstrips.




Webpagetest pagespeed metric comparison

Speedindex measure of visual render time in milliseconds = lower = faster



Time To First Byte (TTFB)



Time till 85% visually complete



Time till 90% visually complete



Time till 95% visually complete

---

Time till 99% visually complete



First Contentful Paint which is Google PageSpeed Insight metric as well



First Meaningful Paint

 

HTTP/2 HTTPS SSL Configurations

CyberPanel OpenLiteSpeed



Centmin Mod Nginx

 

Memory Usage Comparison

Next up is comparing memory using via smem. CyberPanel has much higher memory usage due to having 2 instances of MySQL running, one for the control panel GUI and one for your sites and full email and DNS server out of the box. Centmin Mod out of the box also has memcached server running.

CyberPanel

Code (Text):

 smem -tk
  PID User     Command                         Swap      USS      PSS      RSS 
  924 root     /sbin/agetty --noclear tty1        0   128.0K   142.0K   768.0K 
15511 dovecot  dovecot/anvil                      0   176.0K   214.0K   844.0K 
  472 avahi    avahi-daemon: chroot helpe         0    84.0K   234.0K   492.0K 
15512 root     dovecot/log                        0   324.0K   359.0K  1016.0K 
18072 root     openlitespeed (lscgid              0    92.0K   404.0K     1.1M 
15503 root     /usr/sbin/dovecot -F               0   348.0K   419.0K     1.3M 
 1917 mysql    /bin/sh /usr/bin/mysqld_saf        0   292.0K   427.0K     1.3M 
  466 avahi    avahi-daemon: running [cybe        0   232.0K   448.0K     1.7M 
 2015 root     /bin/sh /usr/bin/mysqld_saf        0   312.0K   449.0K     1.4M 
18068 root     lscpd (lscpd - main                0   104.0K   477.0K     1.4M 
  408 root     /sbin/auditd                       0   516.0K   529.0K     1.0M 
24793 root     dovecot/ssl-params                 0   352.0K   561.0K     1.5M 
  348 root     /usr/lib/systemd/systemd-ud        0   604.0K   627.0K     1.5M 
18219 root     /usr/sbin/crond -n                 0   660.0K   686.0K     1.5M 
  455 root     /usr/lib/systemd/systemd-lo        0   680.0K   706.0K     1.6M 
18847 root     openlitespeed (lscgid              0   592.0K   769.0K     1.2M 
 1032 root     -bash                              0   636.0K   783.0K     1.7M 
  460 dbus     /usr/bin/dbus-daemon --syst        0   892.0K   966.0K     2.1M 
25088 root     dovecot/config                     0   880.0K  1019.0K     1.8M 
26361 sshd     sshd: root [net]                   0   364.0K     1.0M     2.4M 
  914 root     /usr/sbin/sshd -D                  0     1.0M     1.1M     2.6M 
15601 root     /usr/libexec/postfix/master        0     1.2M     1.2M     2.1M 
18840 root     openlitespeed (lshttpd - ma        0   472.0K     1.2M     3.0M 
18914 postfix  tlsmgr -l -t unix -u               0     1.2M     1.3M     2.8M 
15603 postfix  qmgr -l -t unix -u                 0     1.2M     1.3M     2.8M 
 2294 root     pure-ftpd (SERVER)                 0     1.2M     1.3M     2.0M 
18273 opendkim /usr/sbin/opendkim -x /etc/        0     1.4M     1.4M     2.3M 
 1030 root     sshd: root@pts/0                   0     1.4M     1.5M     3.2M 
  607 root     /sbin/dhclient -d -q -sf /u        0     1.9M     2.2M     3.7M 
  609 root     /sbin/dhclient -d -q -sf /u        0     1.9M     2.2M     3.7M 
25703 postfix  pickup -l -t unix -u               0     1.7M     2.2M     4.1M 
26360 root     sshd: root [priv]                  0     1.2M     2.2M     4.9M 
18069 nobody   lscpd (lscpd - #01                 0     2.2M     2.5M     3.4M 
    1 root     /usr/lib/systemd/systemd --        0     2.5M     2.5M     3.4M 
  328 root     /usr/lib/systemd/systemd-jo        0     1.3M     3.1M     5.6M 
  476 root     /usr/sbin/NetworkManager --        0     3.9M     4.2M     6.1M 
  913 root     /usr/sbin/rsyslogd -n              0     3.7M     5.4M     8.1M 
26362 root     python /usr/bin/smem -tk           0     6.8M     7.1M     8.4M 
 2365 pdns     /usr/sbin/pdns_server --gua        0     7.3M     7.5M     9.3M 
  457 polkitd  /usr/lib/polkit-1/polkitd -        0     8.0M     8.3M     9.8M 
18299 cyberpanel /usr/bin/python /usr/bin/gu        0     8.0M    10.6M    14.7M 
18891 cyberpw  lsphp                              0    10.9M    11.1M    13.0M 
  909 root     /usr/bin/python -Es /usr/sb        0    12.7M    12.9M    15.0M 
  475 root     /usr/bin/python -Es /usr/sb        0    25.8M    26.1M    28.2M 
18885 nobody   openlitespeed (lshttpd - #0        0    25.8M    26.5M    28.0M 
18304 cyberpanel /usr/bin/python /usr/bin/gu        0    47.0M    49.9M    54.2M 
 2160 mysql    /usr/sbin/mysqld --basedir=        0    82.1M    83.6M    86.4M 
 2099 mysql    /usr/sbin/mysqld --basedir=        0   100.1M   101.6M   104.3M 
-------------------------------------------------------------------------------
   48 13                                          0   372.1M   392.8M   462.4M 

Centmin Mod

Code (Text):

smem -tk
  PID User     Command                         Swap      USS      PSS      RSS 
  459 avahi    avahi-daemon: chroot helpe    360.0K     4.0K    14.0K    48.0K 
  923 root     /sbin/agetty --noclear tty1        0   128.0K   129.0K   176.0K 
  411 root     /sbin/auditd                  328.0K   164.0K   173.0K   348.0K 
  456 avahi    avahi-daemon: running [cent   316.0K   200.0K   296.0K   532.0K 
  351 root     /usr/lib/systemd/systemd-ud   176.0K   324.0K   353.0K   836.0K 
  607 root     /sbin/dhclient -d -q -sf /u     1.7M   244.0K   416.0K   892.0K 
  463 root     /usr/lib/systemd/systemd-lo   128.0K   660.0K   684.0K     1.0M 
 6167 root     /usr/sbin/crond -n                 0   708.0K   729.0K     1.1M 
  458 dbus     /usr/bin/dbus-daemon --syst   232.0K   680.0K   793.0K     1.3M 
 1276 ntp      /usr/sbin/ntpd -u ntp:ntp -        0   800.0K   842.0K     1.2M 
 6045 root     /usr/sbin/sshd -D                  0     1.0M     1.1M     1.3M 
  329 root     /usr/lib/systemd/systemd-jo   164.0K   696.0K     1.1M     1.9M 
16300 root     /usr/libexec/postfix/master        0     1.1M     1.2M     2.0M 
  609 root     /sbin/dhclient -d -q -sf /u   732.0K     1.2M     1.4M     1.9M 
16302 postfix  qmgr -l -t unix -u                 0     1.3M     1.5M     2.8M 
23226 root     sshd: root@pts/0                   0     1.5M     1.7M     3.1M 
24590 postfix  tlsmgr -l -t unix -u               0     1.6M     1.8M     3.1M 
  912 root     /usr/sbin/rsyslogd -n           3.0M     1.4M     1.8M     2.6M 
    1 root     /usr/lib/systemd/systemd --   116.0K     2.0M     2.1M     2.7M 
23229 root     -bash                              0     2.2M     2.3M     3.0M 
 8119 postfix  pickup -l -t unix -u               0     2.6M     2.8M     4.1M 
  457 polkitd  /usr/lib/polkit-1/polkitd -     5.3M     2.7M     3.0M     3.7M 
  476 root     /usr/sbin/NetworkManager --     1.1M     2.8M     3.1M     3.9M 
22874 root     /usr/sbin/haveged -w 4067 -        0     3.1M     3.1M     3.7M 
31461 memcached /usr/local/bin/memcached -d        0     3.2M     3.2M     3.7M 
12822 root     python /bin/smem -tk               0     6.6M     6.8M     7.7M 
28484 root     php-fpm: master process (/u        0     6.9M     7.0M     7.5M 
  910 root     /usr/bin/python -Es /usr/sb        0    12.8M    13.0M    13.5M 
24006 root     lfd - sleepin                      0    22.2M    22.2M    22.9M 
25812 root     nginx: master process /usr/        0   560.0K    23.0M    45.6M 
25815 nginx    nginx: worker process              0    25.2M    47.7M    70.6M 
22710 mysql    /usr/sbin/mysqld                   0    65.6M    65.8M    67.0M 
-------------------------------------------------------------------------------
   32 9                                       13.6M   172.0M   220.9M   285.7M 

 

Advanced Wordpress Optimizations Enabled

Both CyberPanel installed Litespeed Cache (LSCache) Wordpress plugin and Centmin Mod Nginx auto installed Wordpress with KeyCDN Cache Enabler are capable of advanced optimization features to improve page speed. For Centmin Mod Wordpress you'd need to combine KeyCDN Cache Enabler with 2 other free Wordpress plugins, Autoptimize and Clearfy which are outlined at Wordpress - Revisiting Wordpress Cache Enabler + Autoptimize Plugins For Page Load Speed Optimization

Some features in Litespeed Wordpress Cache plugin - i had to exclude some css form minification as they resulted in 404 not found errors through the Wordpress site if left included in CSS minification.



And here's features for Centmin Mod Wordpress install via Autoptimize and Clearfy

Retest WebpageTest

With the respective advanced optimization features enabled, retesting WebpageTest pagespeed metrics via my new gitools.sh script. Again 3x runs each, 1st run is uncached, 2nd run is cached and 3rd run is cached. Tests were done on same Dulles, VA Cable 5Mbps Chrome browser profiles using command below where domain.com is domain for respective Wordpress installations for CyberPanel and Centmin Mod

Code (Text):

./gitools.sh wpt https://domain.com/ dulles cable

The timing between runs are as follows where there was ~2min and ~3.5min between CyberPanel Wordpress WPT test runs and ~3min and ~2min between Centmin Mod Wordpress WPT runs



Filmstrip again Centmin Mod installed Wordpress with KeyCDN Cache Enabler, Autoptimize and Clearfy are faster than CyberPanel OpenLitspeed with LiteSpeed Wordpress Cache plugin. Visual render time starts early for all 3 runs for Centmin Mod

Full strip



Screenshot

• 1st run, Centmin Mod is 0.6s faster than CyberPanel
• 2nd cached run, Centmin Mod is 0.1s faster than CyberPanel
• 3rd cached run, Centmin Mod is 0.4s faster than CyberPanel and was fastest of all 3 runs
• Notice how much sooner all the text and background image is rendered by Chrome browser with Centmin Mod installed Wordpress and KeyCDN Cache Enabler, Autoptimize and Clearfy combination

detailed metrics

SpeedIndex



Dom Content Loaded



Time to First Byte (TTFB)







First Contentful Paint


First Meaningful Paint


Some page content breakdown by html, css, js, fonts

3rd Run Only WebpageTest Results

If we just narrow down to the 3rd run WebpageTest results they're as follows

Centmin Mod KeyCDN Cache Enabler, Autoptimize and Clearfy combination



CyberPanel Litespeed Cache WP Plugin



Filmstrip

 

Samsung Galaxy S7 Mobile 3G Fast WebpageTest

Next up is doing Samsung Galaxy S7 Mobile 3G Fast WebpageTest comparison page speed tests again in Dulles location.

• Litespeed Wordpress cache plugin has an option to enable mobile caching but it lists as not needed if your wordpress theme has a responsive theme. So caching is disabled in Litespeed Wordpress cache plugin for CyberPanel.
• KeyCDN Cache Enabler doesn't have native distinction between mobile versus desktop. But for Centmin Mod 123.09beta01 centmin.sh menu option 22 wordpress installer, I enabled Cache Enabler with advanced Nginx caching and specifically added optional support for mobile caching via a prompt at initial install. Users can choose whether or not to allow Cache Enabler to cache mobile devices detected or to not cache. Again like Litespeed Wordpress cache plugin, ideally for responsive themes you would disable mobile caching. So mobile caching is also disabled for below tests.
• This means CyberPanel OpenLiteSpeed Wordpress install and Centmin Mod Nginx Wordpress install both have their respective caching components disabled for the below Samsung Galaxy S7 mobile 3G Fast page speed tests but still have above previous post advanced optimization settings enabled.

Results

• CyberPanel/OpenLiteSpeed/LiteSpeed wordpress cache plugin had a faster 1st run.
• However, for 2nd and 3rd runs Centmin Mod/Nginx/Cache Enabler/Autoptimize/Clearfy combination was noticeably faster.

Full film strip



Screenshot split film strip

• Notice when text and background images start rendering. Centmin Mod/Nginx/Cache Enabler/Autoptimize/Clearfy combination started rendering much sooner for 2nd and 3rd run.
• For 1st run, Centmin Mod/Nginx/Cache Enabler/Autoptimize/Clearfy combination text started rendering sooner, but background image CyberPanel/OpenLiteSpeed/LiteSpeed wordpress cache plugin started rendering and displaying sooner.

Metrics

Speedindex



Dom Content Loaded



Time To First Byte (TTFB)



First Contentful Paint



First Meaningful Paint

 

Samsung Galaxy S7 Mobile 3G Fast WebpageTest Round 2

Round 2 for Samsung Galaxy S7 Mobile 3G Fast WebpageTest comparison page speed tests again in Dulles location. This time with respective image optimisation wordpress features

• Litespeed Wordpress cache plugin has an option to optimise images. So enabled and optimised the default 21 images from OceanWP Coach theme installed. Litespeed has better image optimisation.
• For Centmin Mod setup installed WP SmushIT plugin and optimised the default 21 images from OceanWP Coach theme installed. SmushIT free plugin has less image optimisation than their pro version. There are other image optimisation plugins out there though like EWWW Image Optimizer Wordpress Plugin.

Smush IT







LiteSpeed Cache plugin





Results

• CyberPanel/OpenLiteSpeed/LiteSpeed wordpress cache plugin again rendered text and background images later than Centmin Mod/Nginx/Cache Enabler/Autoptimize/Clearfy combination it seems

full film strip



screenshot split into 3 parts





Images bytes comparison

Run 3 Only

Comparing 3rd run only

 

GTMetrix Dallas Chrome Page Speed Tests

Next up is GTMetrix Dallas Chrome tests for CyberPanel/OpenLiteSpeed/LiteSpeed wordpress cache plugin and Centmin Mod/Nginx/Cache Enabler/Autoptimize/Clearfy combinations. Again visual render speed wise, Centmin Mod Cache Enabler combination was faster despite the GTMetrix scores being very close.

PageSpeed



Yslow



Filmstrip where Centmin Mod Cache Enabler is on bottom row for each of the 4 filmstrip compares and shows it starts visual rendering of the 'Professional SPORTS COACH' text at least 2.25-1.00 = 1.25 seconds sooner and visual rendering starts at least 1.50 - 1.00 = 0.5 seconds sooner which is the same faster 0.5s time for Centmin Mod Cache Enabler for when the background image of the person starts rendering (2.75-2.25 = 0.5s).

 

Pingdom PageSpeed Tests

Next up is Pingdom PageSpeed tests for CyberPanel/OpenLiteSpeed/LiteSpeed wordpress cache plugin and Centmin Mod/Nginx/Cache Enabler/Autoptimize/Clearfy combinations using New York location. Not a fan of Pingdom tests as they use outdated Chrome 39 browser which doesn't support HTTP/2 HTTPS.

Did 3x runs each for Pingdom tests - 1st run uncached and 2nd run cached and 3rd run cached.

CyberPanel/OpenLiteSpeed/LiteSpeed wordpress cache plugin

• run 1: Grade 85, Load Time 1.44s, Page Size 1.5 MB, Requests 69
• run 2: Grade 85, Load Time 1.38s, Page Size 1.5 MB, Requests 69
• run 3: Grade 85, Load Time 1.38s, Page Size 1.5 MB, Requests 69

Centmin Mod/Nginx/Cache Enabler/Autoptimize/Clearfy

• run 1: Grade 84, Load Time 1.23s, Page Size 1.5 MB, Requests 66
• run 2: Grade 84, Load Time 1.22s, Page Size 1.5 MB, Requests 66
• run 3: Grade 84, Load Time 1.19s, Page Size 1.5 MB, Requests 66

 

Round 2 testing with CyberPanel 1.7 RC vs Centmin Mod 123.09beta01 has started WebPerf - PageSpeed - Wordpress Webpagetest PageSpeed Comparison for CyberPanel 1.7 RC OpenLiteSpeed vs Centmin Mod LEMP