Getting access to the checkpoint

SkunkworksAI / BakLLaVA

Apache License 2.0

697 stars 47 forks source link

Getting access to the checkpoint #3

Closed monatis closed 11 months ago

monatis commented 11 months ago

Hi, congrats on the release.

Last week I implemented support for LLaVA v1.5 in llama.cpp, and I'd like to do the same for BakLLaVA. I scanned the fork but couldn't notice any architectural change in the mm projector although the readme mentions about "significant architecture changes." And the HF repo is guarded --I requested access but couldn't get it yet. When will it be public so that I can work for implementing it?

pharaouk commented 11 months ago

New code coming soon. V1 is mostly similar arch-wise except a few mods in vision tower which can be turned on/off

monatis commented 11 months ago

Thanks. This is now working: https://huggingface.co/mys/ggml_bakllava-1