search

v-iashin / MDVC

PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)
https://v-iashin.github.io/mdvc
142 stars 19 forks source link

ASR #14

Closed niu1970 closed 3 years ago

niu1970 commented 3 years ago

Hello! I want to ask what API is used to obtain .srt subtitles?

v-iashin commented 3 years ago

See https://github.com/v-iashin/MDVC/issues/11#issuecomment-644612209 Please check this issue it has some advice which might be related to your question. Here is the gist:

Google ASR system used on YouTube has a proprietary license. We don't have access to it and merely used its output downloaded for each video from the service.

If your custom video is not on YouTube, start by looking for a solution that will do the ASR for a video. In a case, if your videos are from YouTube, try to obtain the CC for the video (how? I can only give you a hint: "Google is your friend" 😉).