[feat] Use Ollama or LLMLingua as prompt optimizer or summarize within parsee

CatchTheTornado / doctor-dok

Doctor Dok is an AI based medical data framework and patient's med vault. Parse any health related PDF/Image to JSON and then use Chat GPT / LLama to discuss it! WARNING: Don't decide on your health based on AI Chat - it's just for Research purposes.

http://doctordok.com

MIT License

43 stars 7 forks source link

[feat] Use Ollama or LLMLingua as prompt optimizer or summarize within parsee #114

Open pkarw opened 2 months ago

pkarw commented 2 months ago

We can effectively summarize existing chats for free using Ollama. Then we also can effectively summarize the records during parse to compress it regarding the token usage for further chat

pkarw commented 2 months ago

https://www.microsoft.com/en-us/research/blog/llmlingua-innovating-llm-efficiency-with-prompt-compression/

pkarw commented 2 months ago

https://github.com/microsoft/LLMLingua/tree/main