search

SaFoLab-WISC / Dolphins

[ECCV 2024] The official code for "Dolphins: Multimodal Language Model for Driving“
MIT License
50 stars 8 forks source link

Using llama other than MPT #8

Closed BaekSeongEun closed 1 week ago

BaekSeongEun commented 2 weeks ago

Hello, before issues, thank you very much for your work!

The paper says that you can use the Llama model in addition to MPT, but when I change it to the llama model in inference, an error occurs. I thought it was not supported during the modeling process, but if you let me know if there is a new code for this or if I couldn't find it in the existing code, I would appreciate it!

vlm-driver commented 1 week ago

Thanks for your interest in our work. Our model is based on openflamingo. Therefore, since openflamingo doesn't support the llama as the LLM, our model also can't support llama.