search

yvann-ba / Robby-chatbot

AI chatbot 🤖 for chat with CSV, PDF, TXT files 📄 and YTB videos 🎥 | using Langchain🦜 | OpenAI | Streamlit ⚡
MIT License
764 stars 288 forks source link

OPENAI Alternative #71

Open Zahidpichen1 opened 4 months ago

Zahidpichen1 commented 4 months ago

  1. Is it possible to add open-source llm models like mistral, falcon.

  2. Is it possible to use hugging face embeddings instead of openai embeddings

  3. Is it possible to add multiple csv files which in size sums upto 25GB

I'm creating a chatbot similar to yours. I want to create an FAQ chatbot which uses open-source models. I'm using "Wikipedia dump" dataset from kaggle

The dataset has 29 files, each having size around 1GB

I tried to load the files in chunks but vscode is getting crashed and tells me to reopen it

It would be a great help if this problem get's solved, have been sitting on this around 1 week

Kev744 commented 3 months ago
  1. Yes I think it's possible I am trying to make my own Chatbot with mistral
  2. Yes
  3. Do you make a try with decorator @st.cache ?
ojasmagarwal commented 2 weeks ago

How are you guys creating your own chatbot? I need some help regarding a similar work. I am looking for a chatbot that when a file is uploaded it can tell me insights from the data on its own and with user prompts as well. The chatbot output can contain graphs also. So can anyone guide me with that or any open source model that does this?