npm package related to GPTcache

zilliztech / GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

https://gptcache.readthedocs.io

MIT License

7.14k stars 503 forks source link

npm package related to GPTcache #621

Open kenneth1003 opened 6 months ago

kenneth1003 commented 6 months ago

What would you like to be added?

I am considering developing a basic npm package for a semantic cache feature. Before proceeding, I would like to confirm if there are no similar plans or ongoing work in this area, thanks!

Why is this needed?

For js/ts developers, It would be more friendly through npm package with a simple interface

SimFG commented 6 months ago

@kenneth1003 you can try to use the gptcache server. Of course, it is also nice to develop a basic npm package.