search

BAAI-DCAI / Bunny

A family of lightweight multimodal models.
Apache License 2.0
874 stars 66 forks source link

Encountered an error during model inference after using qwen2. #107

Closed dingtine closed 1 month ago

dingtine commented 2 months ago

error info： ValueError: The checkpoint you are trying to load has model type bunny-qwen but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

in the config.json: "model_type": "bunny-qwen"

After merge the lora with base model, model inference with above error, how to fix it. thanks

Isaachhh commented 2 months ago

https://github.com/BAAI-DCAI/Bunny/issues/39#issuecomment-2021981770

https://github.com/BAAI-DCAI/Bunny/issues/50

dingtine commented 2 months ago

great, it is work. thanks!!