X-PLUG / Youku-mPLUG

Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
Apache License 2.0
280 stars 11 forks source link

How to load the video file in dataset? #4

Open PoetCoderJun opened 1 year ago

PoetCoderJun commented 1 year ago

Nice Job! I have a question, This is the result of 'next(iter(data))'. What's the format of the video file 'b9bb81fd77d4930a889d17adadf83d95209f80d7eb6387933b5aacfad2c52fc7', or can you give an example of how to load the video file?

{'clip_name:FILE': '../modelscope/hub/datasets/modelscope/Youku-AliceMind/master/data_files/b9bb81fd77d4930a889d17adadf83d95209f80d7eb6387933b5aacfad2c52fc7', 'caption': '身穿黑色上衣戴着头盔的女子在路上骑着摩托车四周还停放了一些车'}
MAGAer13 commented 1 year ago

Hi, the video will be stored in ~/.cache/modelscope/hub/datasets/xxxxxxxx

PoetCoderJun commented 1 year ago

Hi, the video will be stored in ~/.cache/modelscope/hub/datasets/xxxxxxxx

Hi, I know the save path, but I don't know what video format 'xxxxxxxx' is. How can we load it or open it?

buptxyb666 commented 1 year ago

I‘m facing the same issue.

MAGAer13 commented 1 year ago

Hi, the video will be stored in ~/.cache/modelscope/hub/datasets/xxxxxxxx

Hi, I know the save path, but I don't know what video format 'xxxxxxxx' is. How can we load it or open it?

In your example, the video should be stored in ~/.cache/modelscope/hub/datasets/modelscope/Youku-AliceMind/master/data_files/b9bb81fd77d4930a889d17adadf83d95209f80d7eb6387933b5aacfad2c52fc7. It will be stored in mp4 format

liguanqun commented 1 year ago

You can open it with VLC media player