zilliztech / GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
https://gptcache.readthedocs.io
MIT License
7.06k stars 500 forks source link

Listen as an OpenAI Complete API #480

Closed SimFG closed 1 year ago

SimFG commented 1 year ago

issue: #319

sre-ci-robot commented 1 year ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: SimFG

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/zilliztech/GPTCache/blob/dev/OWNERS)~~ [SimFG] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
codecov[bot] commented 1 year ago

Codecov Report

Merging #480 (32469ea) into dev (cdec501) will decrease coverage by 0.03%. The diff coverage is 50.00%.

Additional details and impacted files [![Impacted file tree graph](https://app.codecov.io/gh/zilliztech/GPTCache/pull/480/graphs/tree.svg?width=650&height=150&src=pr&token=E30WxqBeJJ&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zilliztech)](https://app.codecov.io/gh/zilliztech/GPTCache/pull/480?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zilliztech) ```diff @@ Coverage Diff @@ ## dev #480 +/- ## ========================================== - Coverage 94.09% 94.06% -0.03% ========================================== Files 93 93 Lines 3808 3810 +2 ========================================== + Hits 3583 3584 +1 - Misses 225 226 +1 ``` | [Impacted Files](https://app.codecov.io/gh/zilliztech/GPTCache/pull/480?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zilliztech) | Coverage Δ | | |---|---|---| | [gptcache/utils/\_\_init\_\_.py](https://app.codecov.io/gh/zilliztech/GPTCache/pull/480?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=zilliztech#diff-Z3B0Y2FjaGUvdXRpbHMvX19pbml0X18ucHk=) | `89.16% <50.00%> (-0.67%)` | :arrow_down: |