Hi, I am not an expert in the LLM topic, but if I got it correctly, this lib has potential to compress the prompts that could lead to faster results:
https://github.com/microsoft/LLMLingua
Maybe it is possible to enable this in background via some checkbox in settings for those who would like to try prompt compression:
Hi, I am not an expert in the LLM topic, but if I got it correctly, this lib has potential to compress the prompts that could lead to faster results: https://github.com/microsoft/LLMLingua
Maybe it is possible to enable this in background via some checkbox in settings for those who would like to try prompt compression:
Hopefully, it could make the LM Studio better.
Best, Vitali