Want to subscribe to topics you're interested in?
Become a Member

Cloudflare How much of your bandwidth/requests are served by Cloudflare?

Discussion in 'Web Development & Web Performance' started by deltahf, Jul 11, 2018.

  1. deltahf

    deltahf Premium Member Premium Member

    587
    265
    63
    Jun 8, 2014
    Ratings:
    +489
    Local Time:
    4:08 AM
    I activated Cloudflare Pro about a week ago on my site. I am using both their Mirage and Polish image services, lossy image compression, serving compressed JS and CSS, and serving .webp images to great effect; I did some before/after comparisons that I hope to post later.

    Anyways, I thought it might be interesting to share analytics data to see how cache rates and bandwidth usage compare with other Centminmod/Cloudflare users.

    I'll get things started. Here's my first week on Cloudflare:

    Screen Shot 2018-07-10 at 1.09.27 PM.png

    Screen Shot 2018-07-10 at 1.09.39 PM.png

    I'm surprised more of my bandwidth isn't getting cached. I have aggressive Page Rules in place to cache all of my XF Image Proxy images and XF attachments, but when I inspect the headers it looks like there are still quite a few misses...

    Looking forward to see what these graphs look like for the rest of you. :)

     
  2. eva2000

    eva2000 Administrator Staff Member

    54,529
    12,212
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,781
    Local Time:
    7:08 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Mines pretty low even with page rules ~20-25% cached. Not sure if that is because I only have some of my 100+ subdomains with orange cloud enabled since I have different subdomains on different servers.

    ok checked, last month 21% cached heh but 35% bandwidth saved
     
  3. gabel

    gabel Member

    68
    38
    18
    Jan 7, 2016
    Ratings:
    +64
    Local Time:
    9:08 AM
    1.9.9
    MariaDB 10
    here are mine for the last week , have both mirage and polish activated . Was expecting the cached bandwidth to be a bit better though.

    07.11.2018-00.06.png

    2018-07-11_0-07-48.png
     
  4. deltahf

    deltahf Premium Member Premium Member

    587
    265
    63
    Jun 8, 2014
    Ratings:
    +489
    Local Time:
    4:08 AM
    Very interesting, @gabel.

    Looks like you've got a lot of room for optimization there! What kind of site is that? XenForo/WordPress?
     
  5. rdan

    rdan Well-Known Member

    5,446
    1,408
    113
    May 25, 2014
    Ratings:
    +2,201
    Local Time:
    5:08 PM
    Mainline
    10.2
    Last Week Stats Wordpress.
    upload_2018-7-11_13-39-50.png

    upload_2018-7-11_13-40-4.png
     
  6. gabel

    gabel Member

    68
    38
    18
    Jan 7, 2016
    Ratings:
    +64
    Local Time:
    9:08 AM
    1.9.9
    MariaDB 10
    @deltahf it's a tube website (adult) and using a script called kernel video. i`ll have to take a look at it because haven't done much since i changed it to cloudflare.
     
  7. Jay Chen

    Jay Chen Active Member

    181
    60
    28
    Sep 10, 2017
    Ratings:
    +116
    Local Time:
    4:08 AM
    Here are mine, very small site 2.PNG
    1.PNG
     
  8. gabel

    gabel Member

    68
    38
    18
    Jan 7, 2016
    Ratings:
    +64
    Local Time:
    9:08 AM
    1.9.9
    MariaDB 10
    did some tweaking and here's how the newest stats look like

    2018-07-24_3-18-18.png

    2018-07-24_3-18-32.png
     
  9. deltahf

    deltahf Premium Member Premium Member

    587
    265
    63
    Jun 8, 2014
    Ratings:
    +489
    Local Time:
    4:08 AM
    @gabel Good caching rate... I want to get my cache rate higher. :(

    What type of site? WordPress/Xenforo?
     
  10. gabel

    gabel Member

    68
    38
    18
    Jan 7, 2016
    Ratings:
    +64
    Local Time:
    9:08 AM
    1.9.9
    MariaDB 10
    @deltahf thanks , it's a video site (adult tube) with about 430k visitors a day and increasing .
     
  11. eva2000

    eva2000 Administrator Staff Member

    54,529
    12,212
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,781
    Local Time:
    7:08 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    that's one very active Centmin Mod LEMP powered site (with help of cloudflare) :D
     
  12. gabel

    gabel Member

    68
    38
    18
    Jan 7, 2016
    Ratings:
    +64
    Local Time:
    9:08 AM
    1.9.9
    MariaDB 10
    @eva2000 yup cloudflare does help but all the credit goes to centmin. After some optimization on the script even without cloudflare it was running like a dream at over 1.25 millions page views per day (CF is great especially since it helped cutting cdn costs :D)
     
  13. deltahf

    deltahf Premium Member Premium Member

    587
    265
    63
    Jun 8, 2014
    Ratings:
    +489
    Local Time:
    4:08 AM
    Oh yes, I forgot you were the same user I asked earlier. :ROFLMAO:

    The numbers that adult sites can bring in are really impressive.
     
  14. eva2000

    eva2000 Administrator Staff Member

    54,529
    12,212
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,781
    Local Time:
    7:08 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    Centmin Mod site + forums had a good day :D How is everyone else doing on Cloudflare now ?

    cf-overview-stats-080319.png
     
  15. deltahf

    deltahf Premium Member Premium Member

    587
    265
    63
    Jun 8, 2014
    Ratings:
    +489
    Local Time:
    4:08 AM
    A great day, indeed. :D

    I'm still very happy with Cloudflare, but I want to cache more. These are my current daily numbers with the new analytics overview:

    Screen Shot 2019-03-08 at 1.28.18 PM.png

    Also, something that might interest you guys: I am running a Cloudflare Worker on requests to XenForo's Image Proxy, proxy.php. Because Workers have their own analytics report, this allows me to see exactly how many of my total requests and bandwidth usage is consumed by embedded forum images, along with the cache rate.

    Last week's stats:

    Screen Shot 2019-03-08 at 1.32.53 PM.png

    Screen Shot 2019-03-08 at 1.32.46 PM.png

    Last week's total requests were 28.2m with 1.09TB consumed, so proxied images account for 6.7% of all requests but consume a whopping 39% of the bandwidth!

    This does make me disappointed that more Image Proxy images are not served by Cloudflare. Because my users are so spread out around the world, and because Cloudflare has so many POPs, odds are lower that multiple users access the same thread/images via the same Cloudflare POP. That means they don't get the accelerated content delivery or the "Polish"-ed or "Mirage"-ed optimized images. The only way around this would be using Argo, but that would cost me hundreds of dollars per month which I can't justify.

    In an odd way, this almost makes the high number of Cloudflare POPs a bad thing, but I don't really want to say that. :ROFLMAO:
     
  16. gabel

    gabel Member

    68
    38
    18
    Jan 7, 2016
    Ratings:
    +64
    Local Time:
    9:08 AM
    1.9.9
    MariaDB 10
    got to say i`m happy with how things are now with cloudflare (and of course centminmod :D )

    [​IMG]
     
  17. eva2000

    eva2000 Administrator Staff Member

    54,529
    12,212
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,781
    Local Time:
    7:08 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    nice so before using workers, your overview bandwidth and request stats were much higher than they are now because the worker request/bandwidth split from main stats ?

    probably depends on how you configure the CF worker cache expiry/invalidation ?

    wow 1 million unique visitors/day !!! That's awesome :cool:
     
  18. Jay Chen

    Jay Chen Active Member

    181
    60
    28
    Sep 10, 2017
    Ratings:
    +116
    Local Time:
    4:08 AM
    That's a very busy site, I will be very happy if this is my monthly traffic. Congrats
     
  19. eva2000

    eva2000 Administrator Staff Member

    54,529
    12,212
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +18,781
    Local Time:
    7:08 PM
    Nginx 1.27.x
    MariaDB 10.x/11.4+
    indeed - hoping one day Centmin Mod gets close. Listing Centmin Mod LEMP stack on DigitalOcean 1-Click Marketplace would hopefully be a step in the right direction :D

    curious how's page views/day count versus cloudflare requests/day counts ?
     
  20. Jay Chen

    Jay Chen Active Member

    181
    60
    28
    Sep 10, 2017
    Ratings:
    +116
    Local Time:
    4:08 AM
    I believe it will. After using CMM, I installed it on all my servers and recommend to my friends.
    It is by far the best.