-
### Bug Description
Occasionally the document `docstore/data` is not being created (KVDocumentStore) when `add_documents` is called
However `docstore/metadata` is consistently being created.
Th…
-
Sensei ran into an issue where ldk-net-tokio (or some other async context) calls into ChannelManager, which handles some message and then goes to update the ChannelMonitor. Because Sensei is using the…
-
## Description
The idea is to provide simple kv-store for other third party apps on IC to consume yral infra by keeping their app stateless and dumping data to individual canisters that are maintai…
-
### Motivation.
There are more and more use cases, where we need to transfer KV caches between vLLM instances, or store KV caches for future use. Some concrete use cases:
- Disaggregated prefilling.…
-
### 🚀 The feature, motivation and pitch
As we can see, Google Gemini can support up to million tokens and to serve longer context length, we have to do context parallelism, which means, split the i…
-
Examine the interface KeyValueStorage and figure out the exact SQLite queries necessary for each function of the trait.
This is a preparation step before actually writing the implementation. Docume…
-
Consul can be used a KV store. Its not the most secure method, but in the absence of a vault setup, it will do fine.
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/datafuselabs/databend/issues) and found no similar issues.
### Version
nightly-630
### What's Wrong?
Upon restart…
-
I noticed [in a Safenet discussion](https://safenetforum.org/t/update-09-june-2022/37150) a mention that `sled` "is buggy and doesn’t seem to be actively maintained", with [Persy](https://docs.rs/pers…
-
### Motivation
在vllm部署推理时,基于kv cache的长度限制,很可能会出现如下情况:
> ValueError: The model's max seq len (19008) is larger than the maximum number of tokens that can be stored in KV cache (3840). Try increas…