[New Model]: Request to integrate Chexagent Multimodel in vLLM

[MohnishJain]

The model to consider.

https://huggingface.co/StanfordAIMI/CheXagent-8b

The closest model vllm already supports.

https://huggingface.co/microsoft/llava-med-v1.5-mistral-7b

What's your difficulty of supporting the model you want?

when i tried to host chexagent it says, model architecture not supported by vllm.its has integrated qformer inside this.any help in integrating this will be helpful.

Before submitting a new issue...

• [X] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

Sorry for the late response, currently BLIP-2 (w/ Q-Former) is supported in vLLM so you may be able to reuse some of the existing code for this model.