search

zilliztech / GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
https://gptcache.readthedocs.io
MIT License
6.96k stars 490 forks source link

[Bug]: #529

Closed Bala534 closed 9 months ago

Bala534 commented 11 months ago

Current Behavior

Hi I am Building the apis where the input prompt will send to the chatgpt and gets the response. I was implemented using gptcache in fastapi python. But the api responses was getting same and sometimes getting the older api responses eventhough the input to the api and the input prompt to the chatgpt was sending correctly.

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

No response

SimFG commented 9 months ago

please give more information about your problem, like: your demo code. and you should write more reasonable issue title