search

dartmouth-cs98-23f / project-short-learning

project-short-learning created by GitHub Classroom
0 stars 0 forks source link

Stream NGINX Server Setup on EC2 #132

Open linkevin281 opened 7 months ago

linkevin281 commented 7 months ago

Stream NGINX Server Setup (8+ Hours)

Background

We previously used S3 to vend our videos using HLS streaming. Unfortunately, the *.ts clip buffers being called each use up 1 API call = one single video uses ~10 API calls. This is way too costly.

Instead, we want to deploy our video storage solution native on our EC2, which also will vend the HLS stream through a NGINX server instance.

This will take lots of linux and potentially daemon work.

Integration

Requirements

  1. Stream testing with this
  2. Research to determine optimal EC2 choice (based on network load, compute, and storage needs)
  3. NGINX setup for HLS
  4. Storage directory format that makes sense for our videos.
  5. Method for ML Service to upload videos by pipelining
  6. When new video is uploaded, makes call to data API to upload metadata.
ColtonSankey commented 7 months ago

Stream functionality tested with Akamai works. All code is hosted on the EC2 instance