search

openchatai / OpenChat

LLMs custom-chatbots console ⚡
https://open.cx
MIT License
5.17k stars 642 forks source link

Is the 5 PDFs/100k words limit a technical limitation? #3

Closed bryceamacker closed 1 year ago

bryceamacker commented 1 year ago

Just wanted to check if that limit is more of a recommendation for the online demo to save on costs, or if there is a technical reason to limit ingestion to that amount. Thank you for building this, it looks like a great product!

gharbat commented 1 year ago

Indeed it's more of a recommendation for the online demo.

You should be able to ingest bigger files (it depend also on your vector database) with no problems.

Also if you have particular use case with large files, I would love to hear about it!

Cheers!

davidfrothin commented 1 year ago

@gharbat - what code should be changed to allow indexing of the entire uploaded PDF?

gharbat commented 1 year ago

It's demo limitation, actually, the self hosted version does not have any limitations (maybe the language is not accurate - will change that)

cheers!

bryceamacker commented 1 year ago

I'm actually adding a local vector store (chroma) and was wondering if that was something you guys discovered during development. I'll submit a PR once I'm happy with it if you are interested.