-
Hi, I am attempting to reproduce the Slide-level vision–language alignment work you conducted. Could you kindly provide any relevant documents or resources for reference?
-
### 🚀 The feature, motivation and pitch
If I am not wrong, currently vllm supports only the **Language models** not the **Vision models**.
NotImplementedError: Pipeline parallelism is only suppo…
-
### 🚀 The feature
Add support for vision-language models like CLIP or LIT.
### Motivation, pitch
Dear torchvision team,
I am sorry if I missed discussions about this or a specific reason why you h…
-
Hi,
I'm trying to constrain the generation of my VLMs using this repo; however i can't figure out the way to personalize the pipeline for handling inputs (query+image). Whereas it is documented as …
-
### 🚀 The feature, motivation and pitch
Takes 1 hour+ on CI compared to others, which take
-
### Your current environment
# Initialize the LLaVA-1.5 model
llm = LLM(model="llava-hf/llava-1.5-7b-hf")
print(llm)
#embed_last_hook = Hook(model.language_model.model.norm) # for save embed
…
-
Is it possible to add {foldername} component for custom PDF renaming? I would like to store PDF files in the folders that I created (e.g. vision, vision-language, dataset).
-
Is it possible to support loading the VLM's like VideoLLama, Chat-UniVi models that can process Videos?
-
- [ ] [Vespa 🤝 ColPali: Efficient Document Retrieval with Vision Language Models — pyvespa documentation](https://pyvespa.readthedocs.io/en/latest/examples/colpali-document-retrieval-vision-language-m…
-
### Motivation
Hi friends,
I'm opening this issue as a place to discuss small vision-language models, please share your thoughts below!
There's recently been great success in research with sm…