yt-dlp / yt-dlp

A feature-rich command-line audio/video downloader
https://discord.gg/H5MNcFW63r
The Unlicense
90.96k stars 7.07k forks source link

Convert slides/storyboards to video #11386

Open flanter21 opened 4 weeks ago

flanter21 commented 4 weeks ago

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

Checklist

Provide a description that is worded well enough to be understood

Sometimes the slides may be higher quality than the video itself. Ideally, this could be combined with the audio from the video. However, the current mhtml implementation of slides does not allow this.

I envision that the slides could be shown sequentially, each running from the timestamp it appears until the next slide appears. Essentially this would be creating a video from the slides.

This would be useful for lectures as mediasite often saves video in very poor quality, but often takes high quality screenshots of the lecture and displays them instead of the video.

However, I do recognise that currently mediasite slide extraction is broken (per https://github.com/yt-dlp/yt-dlp/issues/10320) so instead YouTube could be used as a place to start as the current mhtml "storyboards" calculate the start and end time of each storyboard and the duration of each, so these values could be used to stitch them together.

Provide verbose output that clearly demonstrates the problem

Complete Verbose Output

No response

bashonly commented 4 weeks ago

There was some discussion of this here: https://github.com/yt-dlp/yt-dlp/pull/343#issuecomment-860205931

but it was ultimately deemed too much of a hassle to do at the time, and mhtml was what was settled upon. Mediasite seems like a better candidate for video slides than Youtube, since they use a DASH/DASH-like manifest for them (or least they used to before the extractor broke).