You would have to train the projection layer from scratch as well as perform the second stage finetuning again to work with Llama 2 weights. There have also been reports of people switching to different models and the image input still working but that is not reliable.
Hi,
Has anyone tried the new version of Vicuna weights? Does it work?
Thanks.