bhaskatripathi / pdfGPT

PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!
https://huggingface.co/spaces/bhaskartripathi/pdfGPT_Turbo
MIT License
6.98k stars 837 forks source link

Prompt Optimization by upto 50% more token input #64

Open Shifat7 opened 1 year ago

Shifat7 commented 1 year ago

By removing whitespaces and trimming most letters to the most discernible sentence possible we can allow even more tokens inside our prompt by upto a staggering 50% and hence even more larger support of pdf sizes to occur. The algorithm in use will be taken from a reputable source linked after completing the issue.

image

Please allow me to assign to this issue and I will make a stable release sometime in June. Thank you.