Scaling Video streaming with Nginx

[haminhcong]

Problems

To archive High Availability, We usually store mp4 video on S3 Like Object Storage. However, at some infrastructure, the Object Storage Raw Performance is not enough for an high demand video. In this case, user usually using Object Storage with CDN is a good options. But, if for some reason, you have compute resource and does not want to using CDN for some reason (pricing, for example), then built a nginx or something like this is not a bad option.

Goals

• Find a way to using Nginx or Vanish Cache to caching video content from Object Storage instead CDN with HA Architecture
• Write an document

Some referrence links

• https://github.com/varnishcache/varnish-cache
• https://blog.nginx.org/blog/using-nginx-as-object-storage-gateway
• https://github.com/nginxinc/nginx-s3-gateway
• https://community.fly.io/t/running-a-global-object-cache-cluster-using-nginx/3387
• https://github.com/auth0/cxn
• https://info.varnish-software.com/blog/caching-partial-objects-varnish

[haminhcong]

How to caching video with varnish cache

• https://adapt.to/2013/presentations/adaptto2013-become-happier-by-using-varnish-cache-stefan-maurer.pdf