Learn about Centmin Mod LEMP Stack today
Register Now

Sysadmin Help with a solution for video streaming :(

Discussion in 'System Administration' started by KinderOvO, Sep 1, 2018.

  1. eva2000

    eva2000 Administrator Staff Member

    58,892
    12,490
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +19,122
    Local Time:
    7:55 AM
    Nginx 1.31.x
    MariaDB 10.x/11.4+/12.3+
    Not sure if @KinderOvO is still using it, but he did hire me back then to deploy the Nginx sliced byte range caching configuration I mentioned here and here.

     
  2. pdinh97qng

    pdinh97qng Member

    121
    15
    18
    Jan 24, 2016
    Ratings:
    +39
    Local Time:
    2:55 PM
    Just purchase a tool that will upload video to google photos and drive and stream from there. There is a technology call P2P, the tool will split the video in to tons of .txt file so google can’t scan DMCA cause it’s .txt and google doesn’t have limit for such a small file like .txt.
     
  3. skringjer

    skringjer NoobMaster69

    208
    26
    28
    Apr 21, 2019
    Ratings:
    +43
    Local Time:
    2:55 AM
    Nginx 1.21.6
    MariaDB 10.3.x
    Can you shed some more light onto this? How does it work and where can we get it.
     
  4. ndha

    ndha Member

    83
    10
    8
    Sep 28, 2014
    Ratings:
    +29
    Local Time:
    4:55 AM
    1.27
    10.6
    I knew it must be vanlong tool, but i suggest don't use it..
    IF Google change algorithm, then he will not fix it, instead charge you another Thousand to buy new tool.
    I'm not using his tool anymore.
     
  5. rdan

    rdan Well-Known Member

    5,452
    1,418
    113
    May 25, 2014
    Ratings:
    +2,212
    Local Time:
    5:55 AM
    Mainline
    10.2
    I'm on similar situation now :), helping a friend to run a video site (started few months ago).
    Using:
    • Xenforo with XFMG
    • Force transcoding of all videos to H.264 / AAC / MP3 (to have smaller file size and easy to play and skip)
    • With some Nginx configs...
    • sendfile_max_chunk 5m;
    • limit_rate_after 5m;
    • limit_rate 5120k;
    • Later I'll serve all videos on separate high bandwidth Server using ngx_http_proxy_module
    Serving 1-2 TB per day seems to work fine for now.
     
  6. JAFRI

    JAFRI New Member

    8
    2
    3
    Feb 26, 2019
    Ratings:
    +4
    Local Time:
    2:55 AM
    nginx/1.15.9
    MariaDB 10.2.22
    I had a similar issue when my daily video streaming usage skyrocketed. The main headache was syncing big files across multiple servers, it’s tricky to keep everything up to date without eating a chunk of the available bandwidth. I experimented with splitting bandwidth over a few nodes but still needed to optimize codec choice and bitrate on the videos to really cut down bandwidth. Serving smaller webms or compressed mp4s helped a lot, plus tweaking how aggressively files are cached on each server.

    If you ever need to transcode or compress a batch of videos fast, movavi has come in handy for me. I usually process my files with that before uploading to save space and get better streaming speeds.
     
  7. rdan

    rdan Well-Known Member

    5,452
    1,418
    113
    May 25, 2014
    Ratings:
    +2,212
    Local Time:
    5:55 AM
    Mainline
    10.2
    I have a 3-year-old forum now with this daily usage:
    • Unique visitors: 200-300k
    • Request: 70-75 million
    • Data or Bandwidth use: 60-70 TB (99% cached via cloudflare)
    The forum is only accepting up to a 100 MB max file size attachment, yet I already accumulated 6.5 TB of storage using Cloudflare R2.
    My only issue now is to lower the total size :|