Allow video, thumbnails, captions to come from multiple S3 buckets

mbertrand commented 6 years ago

Cloudfront URL's need to be mapped to S3 buckets (devops) - part of #411? For example:

S3 keys for TechTV videos, thumbnails, captions need to be assigned with a techtv prefix, for example techtv/thumbnails/9d6aa5cf9b6e4d07a0dfdcd9aaf633f0/video_thumbnail_00001.jpg instead of thumbnails/9d6aa5cf9b6e4d07a0dfdcd9aaf633f0/video_thumbnail_00001.jpg (via code)

pdpinch commented 6 years ago

I think the mapping of S3 to cloudfront is part of #411 -- please add a comment and/or edit the description.

This issue was for any necessary data model and front-end changes.

mbertrand commented 6 years ago

Each VideoS3 object (used for video files, thumbnails, and captions) has a bucket_name and s3_object_key property. These can be set to the appropriate TechTV bucket and path when creating an object, for example:

VideoThumbnail.objects.get_or_create(
     s3_object_key='techtv/thumbnails/<video_key>/001.jpg',
     bucket_name='odl-video-services-techtv-thumbnails-ci'
     video=video
)

Each cloudfront URL is based on the S3 object key, so assuming the cloudfront distribution maps unique URL paths for techtv files to S3 buckets, everything should just work.

A complication is that each VideoFile is assumed to be either the original uploaded file or an m3u8 playlist of transcoded files, which won't be the case for TechTV videos. That will be addressed as part of #413.

pdpinch commented 6 years ago

Does that mean we can just close this?

mbertrand commented 6 years ago

Yes, I'll close it.

mitodl / odl-video-service

Allow video, thumbnails, captions to come from multiple S3 buckets #412