search

zilliztech / GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
https://gptcache.readthedocs.io
MIT License
7.15k stars 503 forks source link

[Feature]: Cache answer diversity #551

Open SimFG opened 12 months ago

SimFG commented 12 months ago

Is your feature request related to a problem? Please describe.

Currently, when GPTCache evaluates similarity, it retrieves cached answers that meet the similarity threshold. However, in many generation scenarios, users may desire a range of answers that exhibit similar meaning but offer more content diversity.

Are you looking for a lightweight model that can easily rewrite text?

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

Vasanthavel124 commented 12 months ago

Can you assign this to me?

SimFG commented 12 months ago

@Vasanthavel124 It's ok. Do you want to try all the latest features?

Vasanthavel124 commented 12 months ago

@Vasanthavel124 It's ok. Do you want to try all the latest features?

@SimFG Yes