search

rxtan2 / Koala-video-llm

BSD 3-Clause "New" or "Revised" License
28 stars 4 forks source link

about demo release #3

Open shuyansy opened 4 months ago

shuyansy commented 4 months ago

Hi~ Thanks for your update and pretrained weight. Is there a demo.py so that I can perform zero-shot evaluation on my samples? Thanks so much!

rxtan2 commented 4 months ago

Hi @shuyansy , I have uploaded a demo_video file. Please try it and let me know if you face any issues. Thank you very much!

insafim commented 3 months ago

The demo is not working properly too.

Screenshot 2024-05-09 at 8 34 04 PM Screenshot 2024-05-09 at 8 34 19 PM Screenshot 2024-05-09 at 8 34 28 PM

shuyansy commented 3 months ago

Thanks for your udpate! However,Could you provide a single inference.py file without gradio ? It may be more convenient for more people to try it. thanks for your time.

rxtan2 commented 3 months ago

@shuyansy I have uploaded a sample inference file for video question answering and updated the README too.

shuyansy commented 3 months ago

thanks, Do you mean the evaluationfor egoschema file? Could you provide a file than can process my own single video file? (just like the one in video_demo.py but without the gradio.)

yukio0321 commented 1 month ago

Thanks for your udpate! However,I have an AssertionError: Unknown model type llama_v2 when I try the demo_video.py.