anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/
https://anarchy.ai/
MIT License
465 stars 150 forks source link

Added caching for repititive requests on the `/v1/complete` endpoint #430

Open ShivamHP opened 5 months ago

ShivamHP commented 5 months ago

Resolves #362

I am also planning to resolve the issue #360. But I need to clarify some doubts: