I run InstructBLIP successfully when LLM is flant5xl or flant5xxl, but when I switch LLM as vicuna-7b-v1.1, the output is a string of nothing(['']). Actually, when I use vicuna-7b-v0, there are some reasonable outputs (like 'the image features ...', 'in this image, there is ...' ), but sometimes repeated answer or '### Assistant: ....' happens.
I run InstructBLIP successfully when LLM is flant5xl or flant5xxl, but when I switch LLM as vicuna-7b-v1.1, the output is a string of nothing(['']). Actually, when I use vicuna-7b-v0, there are some reasonable outputs (like 'the image features ...', 'in this image, there is ...' ), but sometimes repeated answer or '### Assistant: ....' happens.