mayooear / gpt4-pdf-chatbot-langchain

GPT4 & LangChain Chatbot for large PDF docs
https://www.youtube.com/watch?v=ih9PBGVVOO4
14.73k stars 3k forks source link

Alternative for OpenAI for embeddings? #414

Closed nisuJaiswal closed 2 months ago

nisuJaiswal commented 9 months ago

Is there any another alternative way for embed pdf using model instead of OpenAI? Because openai will cost more with increase in pdf size. So, if there any other model of langchain is there that embeds pdfs, then please suggest!

govind-kumarr commented 9 months ago

@nisuJaiswal Hugging face is only option left i guess.

dosubot[bot] commented 6 months ago

Hi, @nisuJaiswal

I'm helping the gpt4-pdf-chatbot-langchain team manage their backlog and am marking this issue as stale. From what I understand, you opened this issue to discuss alternatives to OpenAI for embedding PDFs using a model due to increasing costs. A potential alternative, Hugging Face, was suggested and received a positive response from you.

Could you please confirm if this issue is still relevant to the latest version of the gpt4-pdf-chatbot-langchain repository? If it is, please let the gpt4-pdf-chatbot-langchain team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days. Thank you!

araza110 commented 5 months ago

@nisuJaiswal Hugging face is only option left i guess.

Can you show in code, how do you implement hugging face instead of openAI Embedding?

dosubot[bot] commented 5 months ago

@mayooear, could you please assist with implementing Hugging Face instead of OpenAI Embedding as requested by @araza110? Thank you!