feat: add video loader - Githubissues

jina-ai / executors

internal-only

Apache License 2.0

31 stars 12 forks source link

Closed makram93 closed 2 years ago

makram93 commented 2 years ago

Video Loader that loads frames and audio as chunks which can be retrieved by using modality='audio' or modality='image'.

tadejsv commented 2 years ago

Two comments:

if you want to create temporary files/directories, use python's tempfile library
you might not even need that. You can use ffmpeg to read the video directly to frames, see https://github.com/kkroening/ffmpeg-python/blob/master/examples/README.md#convert-video-to-numpy-array . For audio it might be a bit harder, but I think still possible?