How to use LAVIS to video retrieval?

salesforce / LAVIS

LAVIS - A One-stop Library for Language-Vision Intelligence

BSD 3-Clause "New" or "Revised" License

9.86k stars 967 forks source link

How to use LAVIS to video retrieval? #197

Open JewelChen2019 opened 1 year ago

JewelChen2019 commented 1 year ago

I want to use this code base to test the performancc ALPRO on MSRVTTT, but I did not find the tutorial of how to process video and do a text to video retrieval.

qq846511277 commented 1 year ago

Have you found the answer?

dxli94 commented 1 year ago

See example: https://github.com/salesforce/LAVIS/blob/main/run_scripts/alpro/eval/eval_msrvtt_ret.sh.