feat: add transformers vision molmo

ai-bot-pro / achatbot

An open source chat bot architecture for voice/vision (and multimodal) assistants, local and remote to run; if u run achatbot by yourself, u can learn more, star and fork to contribute~

BSD 3-Clause "New" or "Revised" License

15 stars 2 forks source link

feat: add transformers vision molmo #68

Closed weedge closed 1 month ago

weedge commented 1 month ago

feat:

add transformers vision molmo, MolmoE-1B-0924, Molmo-7B-O-0924, Molmo-7B-D-0924 on transformers inference(generate) with streamer(streaming); need use A100 40G to run

notebook:

https://github.com/weedge/doraemon-nb/blob/main/achatbot_vision_qwen_vl.ipynb
https://github.com/weedge/doraemon-nb/blob/main/transformers_llm_vision.ipynb

fix:

image inputs and device check