/ Register

Want more timely Centmin Mod News Updates?
Become a Member

Test thread (large image attachments)

Discussion in 'Testing Forum' started by Amin Sabet, Dec 5, 2016.

Previous Thread Next Thread
Loading...
Page 2 of 3
  1. Dec 5, 2016 #21
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
    Here's the same image optimized by your site without resizing (346kb, 1600px): https://community.centminmod.com/da...3a4c43d4df_h.jpg.pagespeed.ic.M2hWhONYcV.webp

    Impressive file savings!
     
  2. Dec 5, 2016 #22
    eva2000

    eva2000 Administrator Staff Member

    53,178
    12,112
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,647
    Local Time:
    11:20 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Indeed ngx_pagespeed still 32% savings at same resolution or 79% savings at ngx_pagespeed optimised resolution

    @1680x1050 viewport webpagetest.org comes in at page size 7,526 KB

    ngx_pagespeed-51216-viewport-1680x1050.png
     
  3. Dec 5, 2016 #23
    eva2000

    eva2000 Administrator Staff Member

    53,178
    12,112
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,647
    Local Time:
    11:20 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    ouch pricey indeed Cloudinary - Pricing
    • 1 million images = $44/month
    • 3 million images = $134/month
    • 5 million images = $224/month
     
  4. Dec 5, 2016 #24
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
    It's very tempting. Wish
    Those are with 10% discount for paying a year in advance.

    I subscribed to the $249/month and used 12% of my monthly transformations limit overnight :eek:.
     
  5. Dec 5, 2016 #25
    eva2000

    eva2000 Administrator Staff Member

    53,178
    12,112
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,647
    Local Time:
    11:20 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    ouch - maybe limit large attachment quotas to paid upgraded subscription users ? someone has to pay for the cost !
     
  6. Dec 5, 2016 #26
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
    I think Cloudinary is just not going to work out for me.

    KeyCDN is very affordable. I just wish they offered some image optimization.

    Of note, none of my peers (other photography forums) are doing anything to optimize images based on the visitor. Large forums like POTN, DPReview, and Fred Miranda simply serve the images up straight. DPReview shows a very small version in the thread view (you have to click through for full size), and POTN/FM recommend smaller image sizes.

    I also tried another service called ImageEngine. Worked incredibly well, but the prices made Cloudinary look cheap o_O.
     
  7. Dec 5, 2016 #27
    eva2000

    eva2000 Administrator Staff Member

    53,178
    12,112
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,647
    Local Time:
    11:20 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    yeah been working with forums for 15+ yrs and my experience has always led me to strictly limit image/attachment size as over time attachments can get out of hand i.e. had one client with 450+ GB of attachments and just the additional disk and server resources/bandwidth to handle that can get out of hand !

    The other option is build and roll out your own custom private CDN like server cluster. I've done that before with centmin mod nginx + ngx_pagespeed with geodns latency based DNS and nginx proxy_cache/proxy_store. That probably could end up as costly as for equivalent to origin performance, custom CDN servers would have to have close hardware specs :)

    Actually centminmod.com site is partially built in such a way too across a cluster of VPS servers geographically dispersed :)
     
  8. Dec 6, 2016 #28
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
    How can I test if my server port speed is a bottleneck?
     
  9. Dec 6, 2016 #29
    Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    2:20 PM
    1.5.15
    MariaDB 10.2
    Code:
    [root@server ~]# wget http://speedtest.newark.linode.com/100MB-newark.bin
--2016-12-05 15:25:59--  http://speedtest.newark.linode.com/100MB-newark.bin
Resolving speedtest.newark.linode.com (speedtest.newark.linode.com)... 50.116.57.237, 2600:3c03::4b
Connecting to speedtest.newark.linode.com (speedtest.newark.linode.com)|50.116.57.237|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: ‘100MB-newark.bin’

100MB-newark.bin                                          100%[=====================================================================================================================================>] 100.00M  12.5MB/s    in 8.7s    

2016-12-05 15:26:08 (11.6 MB/s) - ‘100MB-newark.bin’ saved [104857600/104857600]

[root@server ~]#
    Code:
    [root@server ~]# wget http://speedtest.dallas.linode.com/100MB-dallas.bin
--2016-12-05 15:26:31--  http://speedtest.dallas.linode.com/100MB-dallas.bin
Resolving speedtest.dallas.linode.com (speedtest.dallas.linode.com)... 50.116.25.154, 2600:3c00::4b
Connecting to speedtest.dallas.linode.com (speedtest.dallas.linode.com)|50.116.25.154|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: ‘100MB-dallas.bin’

100MB-dallas.bin                                          100%[=====================================================================================================================================>] 100.00M  12.5MB/s    in 8.5s    

2016-12-05 15:26:40 (11.8 MB/s) - ‘100MB-dallas.bin’ saved [104857600/104857600]

[root@server ~]#
    Ask HiVelocity if they have any MTRG graphs of your server showing the bandwidth usage.
     
  10. Dec 6, 2016 #30
    Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    2:20 PM
    1.5.15
    MariaDB 10.2
    You've also got iftop on your server, so running that will show real time network usage.
     
  11. Dec 6, 2016 #31
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
    Isn't that much slower than expected?
     
  12. Dec 6, 2016 #32
    Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    2:20 PM
    1.5.15
    MariaDB 10.2
    I'm not sure if Linode are limiting those, because I get the same rate on my servers in France
    Code:
    root@cp2 [~]# wget http://speedtest.dallas.linode.com/100MB-dallas.bin
--2016-12-05 15:32:30--  http://speedtest.dallas.linode.com/100MB-dallas.bin
Resolving speedtest.dallas.linode.com (speedtest.dallas.linode.com)... 50.116.25.154, 2600:3c00::4b
Connecting to speedtest.dallas.linode.com (speedtest.dallas.linode.com)|50.116.25.154|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: ‘100MB-dallas.bin’

100%[==============================================================================================================================================================================================>] 104,857,600 11.8MB/s   in 9.7s  

2016-12-05 15:32:40 (10.4 MB/s) - ‘100MB-dallas.bin’ saved [104857600/104857600]

root@cp2 [~]#
    But their London one
    Code:
    root@cp2 [~]# wget http://speedtest.london.linode.com/100MB-london.bin
--2016-12-05 15:32:02--  http://speedtest.london.linode.com/100MB-london.bin
Resolving speedtest.london.linode.com (speedtest.london.linode.com)... 176.58.107.39, 2a01:7e00::4b
Connecting to speedtest.london.linode.com (speedtest.london.linode.com)|176.58.107.39|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 104857600 (100M) [application/octet-stream]
Saving to: ‘100MB-london.bin’

100%[==============================================================================================================================================================================================>] 104,857,600  101MB/s   in 1.0s  

2016-12-05 15:32:03 (101 MB/s) - ‘100MB-london.bin’ saved [104857600/104857600]

root@cp2 [~]#
     
  13. Dec 6, 2016 #33
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
    Is this what you mean?

    bandwidth.png
     
  14. Dec 6, 2016 #34
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
  15. Dec 6, 2016 #35
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
    It doesn't make sense to me that the minute I enable CDN, the download speeds for those images dramatically improve even though those images aren't cached on the CDN yet. It's as if the server port speed increases when I access the images via CDN.
     
  16. Dec 6, 2016 #36
    Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    2:20 PM
    1.5.15
    MariaDB 10.2
    That's because Chrome for example will download the files sequentially, because they are on the same domain. Putting them on the CDN allows them to be downloaded in parallel, speeding it up.

    nginx - Why my browser wouldn't load all image resources at once? - Server Fault
     
  17. Dec 6, 2016 #37
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
  18. Dec 6, 2016 #38
    eva2000

    eva2000 Administrator Staff Member

    53,178
    12,112
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,647
    Local Time:
    11:20 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    possibly misconfigured ngx_pagespeed and/or bug

    webpagetest ps vs no ps shows no pagespeed faster with smaller pages ? not sure how that is possible

    nops-vs-ps.gif

    try excluding /attachments/* from ngx_pagespeed as it could be trying to do webp conversions on images without image extensions
     
  19. Dec 6, 2016 #39
    Matt

    Matt Well-Known Member

    925
    414
    63
    May 25, 2014
    Rotherham, UK
    Ratings:
    +669
    Local Time:
    2:20 PM
    1.5.15
    MariaDB 10.2
    I've just totally disabled Pagespeed on the server with
    Code (Text):
    pscontrol off


    Any different?
     
  20. Dec 6, 2016 #40
    Amin Sabet

    Amin Sabet Member

    49
    7
    8
    Nov 8, 2015
    Ratings:
    +14
    Local Time:
    9:20 AM
Previous Thread Next Thread
Loading...
Page 2 of 3

.