search

ganler / ResearchReading

General system research material (not limited to paper) reading notes.
GNU General Public License v3.0
20 stars 1 forks source link

SOSP'17 | SVE: Distributed Video Processing at Facebook Scale #37

Closed ganler closed 3 years ago

ganler commented 3 years ago

From: https://www.cs.princeton.edu/courses/archive/fall19/cos418/docs/L19-sve.pdf

ganler commented 3 years ago

The motivation is to accelerate video pre-sharing:

Legacy

  1. User clients send video content to the web server;
  2. Web servers send the original data to original storage;
  3. original storage => Pre-processing servers to get video data of different RESOLUTION/ENCODING;
  4. Video data of different ENCODING are stored;

Then the video can be viewed by people;

SVE

Add some parallelism: Overlapping + Parallel (distribute encoding tasks to different workers)

image

Results

2.3(overlapping)~9.3(+parallel) speedup;

Comment

Quite engineering and practical;