How to use “chat.generate()” to generate answers in batch

OpenGVLab / Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

https://vchat.opengvlab.com/

MIT License

3k stars 247 forks source link

How to use “chat.generate()” to generate answers in batch #60

Closed Summer-seu closed 8 months ago

Summer-seu commented 1 year ago

Thank you for sharing us with your great works! I would like to ask how to use “chat.generate” function in "demo.py" file to generate answers in batch?

yinanhe commented 1 year ago

change the tokenizer.decode to tokenizer.batch_decode

yinanhe commented 8 months ago

Due to the lack of updates for a long time, your issue has been temporarily closed. If you still have any problems, please feel free to reopen this issue.