search

BAAI-DCAI / Bunny

A family of lightweight multimodal models.
Apache License 2.0
865 stars 65 forks source link

model.safetensors is slow to load #16

Closed carry-xz closed 5 months ago

carry-xz commented 6 months ago

Can't wait to try, but the gradio page can't launch, what version of gradio you are using? The cli is slow to load model.safetensors

Isaachhh commented 6 months ago

Now the demo page can be opened. Thanks for feedback!

For slow cli loading, could you share more information? If you have downloaded the weights of lora and base llm, cli loading would be very quick.

Also, you can try the quick-starting snippet here.

carry-xz commented 5 months ago

git pull , it's work!