search

BAAI-DCAI / Bunny

A family of lightweight multimodal models.
Apache License 2.0
799 stars 61 forks source link

Do you plan to train the vlm using llama3 70b instruct？ #65

Closed Alethx closed 1 month ago

BAAI-DCAI commented 2 months ago

Hi Alethx, thanks for the question. We currently focus on lightweight MLLMs and don't plan to train with Llama3-70B.

ChaseKolozsy commented 2 months ago

Hi Alethx, thanks for the question. We currently focus on lightweight MLLMs and don't plan to train with Llama3-70B.

I was thinking about merging your bunny-llama3-8b-V model with llama3-70b, do you think that would work? or is it a waste of time and money?

Isaachhh commented 1 month ago

Well, probably not working.

Isaachhh commented 1 month ago

Close the issue for now if there's no further discussions. Feel free to reopen it if there's any other questions.