Luodian / Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
https://otter-ntu.github.io/
MIT License
3.55k stars 242 forks source link

luodian/OTTER-MPT1B-RPJama-Init generate empty? #241

Closed hitxujian closed 1 year ago

hitxujian commented 1 year ago

thanks for sharing. i use otter_video.py to test luodian/OTTER-MPT1B-RPJama-Init, but find that output is empty,and the decdoer id is large than model.text_tokenizer.vocab_size, can you give me some explanation?