search

TinyLLaVA / TinyLLaVA_Factory

A Framework of Small-scale Large Multimodal Models
https://arxiv.org/abs/2402.14289
Apache License 2.0
597 stars 53 forks source link

mof_mlp error #94

Open Daming-W opened 3 months ago

Daming-W commented 3 months ago

image hi team, I am trying to reproduce mof(clip-vit+dinov2-vit) and Vicuna-7b. And i am facing the error shown in the image. And here is the training settings. image

jiajunlong commented 3 months ago

There is a bug in our codebase. Please change @register_connector('mof_mlp') to @register_connector('mof') of the codebase, and then change CN_VERSION=mof_mlp to CN_VERSION=mof in your script.