-
It would be nice to have an optional mode permitting to monitor the number of token the Semantic Cache permits to save.
To do so, today we can store the token as metadata item.
```python
from la…
-
I've run into an interesting issue while testing RedisSemanticCache, and I'm hoping someone can shed some light on whether this is expected behavior or potentially a bug.
**Setup:**
- Using redis…
-
We are working with Azure Cache for Redis and getting below error when initializing Semantic cache with redisvl module.
```
r = Redis(host=REDIS_ENDPOINT, port=6380, password=REDIS_PASSWORD, ssl=Tru…
-
I am using `SemanticCache` to cache the LLM responses in my application, following [this document](https://www.redisvl.com/user_guide/llmcache_03.html#cache-access-controls-tags-filters). However, I a…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain.js documentation with the integrated search.
- [X] I used the GitHub search to find a …
-
I am following the official documentation scrips for semantic cache. In the following code
```
from redisvl.extensions.llmcache import SemanticCache
llmcache = SemanticCache(
name="llmcache", …
-
I am following the official documentation scrips for semantic cache. In the following code
```
from redisvl.extensions.llmcache import SemanticCache
llmcache = SemanticCache(
name="llmcache", …
-
Tried the given code
```
from redisvl.extensions.llmcache import SemanticCache
llmcache = SemanticCache(
name="llmcache", # underlying search index name
prefix="llmcac…
-
Hi, is there a way to hold a pre defined redis cache instance somewhere? I currently define everytime a request comes in a new one what takes way too loong.
So there must be the apprich to hold it s…
-
I was thinking it might be useful (or at least interesting) if Spring AI public metrics regarding token usage via the Actuator metrics endpoint. This information comes from the `ChatResponse` (formerl…