search

ajayyy / SponsorBlock

Skip YouTube video sponsors (browser extension)
https://sponsor.ajay.app
GNU General Public License v3.0
10.21k stars 323 forks source link

Detect intros #1460

Open turkeyphant opened 2 years ago

turkeyphant commented 2 years ago

I searched around and couldn't find anything about this.

Is there any way for SponsorBlock to detect intros? When a channel uses exactly the same intro sequence on every video but not always exactly at the beginning?

Could SponsorBlock read the video footage and skip the same section on every video where it appears? Or at least is there a fast workflow to automatically mark these?

Jan-Koll commented 2 years ago

I am not familiar with the code and infrastructure of SponsorBlock, but here is what I think: It's a nice idea, but in my opinion and to the best of my knowledge rather unrealistic. Not only would the server need to run some sort of computer vision program to process all the video (which is expensive and would take a while), but it would also be extremely difficult to universally recognize whether, for example, a text that is in an opening scene is an intro or already the beginning of the main content. It would be much easier with movies or TV series e.g. on Netflix, where one can assume a more or less similar structure and duration of intro, recap, outro, ... YouTube videos, however, do not follow such a structure - some videos even contain only an intro and nothing else.

turkeyphant commented 2 years ago

I am not familiar with the code and infrastructure of SponsorBlock, but here is what I think: It's a nice idea, but in my opinion and to the best of my knowledge rather unrealistic. Not only would the server need to run some sort of computer vision program to process all the video (which is expensive and would take a while), but it would also be extremely difficult to universally recognize whether, for example, a text that is in an opening scene is an intro or already the beginning of the main content. It would be much easier with movies or TV series e.g. on Netflix, where one can assume a more or less similar structure and duration of intro, recap, outro, ... YouTube videos, however, do not follow such a structure - some videos even contain only an intro and nothing else.

Could it not be done locally in browser by the extension? Or at least give a "hint" when adding your own sections?

mchangrh commented 2 years ago

There are certain projects that are automating detection like NN-Block and there are also proof of concepts for jumping on video transitions.

Automated times https://github.com/ajayyy/SponsorBlock/issues/799

Disclaimer for automated segments https://wiki.sponsor.ajay.app/w/Automating_Submissions