mlpc-ucsd / BLIVA

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
https://arxiv.org/abs/2308.09936
BSD 3-Clause "New" or "Revised" License
257 stars 26 forks source link

Custom Data and Internet Connection for LLM #16

Open oscarzhou511 opened 8 months ago

oscarzhou511 commented 8 months ago

Hello, I’m looking into connecting multimodal LLMs to some custom data or possibly connecting it to the internet. This does not needed to be incorporated into the visual aspect - only the LLM itself, so tools like LLaMaIndex and Langchain should be enough.

I’m interested in connecting the Vicuna 7B model. Any type of assistance would be greatly appreciated.

Thank you so much for reading this issue.

Oscar Zhou