search

alejandro-ao / ask-multiple-pdfs

A Langchain app that allows you to chat with multiple PDFs
1.6k stars 913 forks source link

Keeps getting inputs too long error #34

Open wenzhao98 opened 11 months ago

wenzhao98 commented 11 months ago

changed embedding to hkunlp/instructor-large and using HuggingFace instead of OpenA. Keeps getting the following error:

ValueError: Error raised by inference API: Input validation error: inputs must have less than 1024 tokens. Given: 1062

I think it is due to the memory.

costabm commented 8 months ago

Check my pull request (#45) where the "chunk_size" and "max_new_tokens", have been updated, among other improvements.