RupertLuo / Valley

The official repository of "Video assistant towards large language model makes everything easy"
199 stars 13 forks source link

Inference in command line fails #14

Closed fazlicodes closed 11 months ago

fazlicodes commented 11 months ago

When I run the code: python3 valley/inference/run_valley.py --model-name ./weights/Valley2-7b/ --video-file ./test_videos/the_wait.mp4 --query "What is happening in this video?" I get the error: ValueError: You need to specify the <video> token in the query

RupertLuo commented 11 months ago

The \<video> token is a placeholder symbol for video. You need to write like this "What is happening in this video?\n\<video>"

fazlicodes commented 11 months ago

Thanks it worked