search

codefuse-ai / ModelCache

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.
Other
892 stars 44 forks source link

Modelcache dev #47

Closed peng3307165 closed 2 months ago

peng3307165 commented 2 months ago

add m_faiss.index remove invalid parameter default value remove openai sdk fix vecotr_data/redis.py