issues
search
v6d-io
/
v6d
vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)
https://v6d.io
Apache License 2.0
818
stars
117
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add file system as the optional storage for KVTensor in vineyard llm kv cache
#1833
dashanji
closed
2 months ago
0
Implement the hash matching of prompt prefix in vineyard llm kv cache
#1832
dashanji
closed
2 months ago
0
[k8s]: Remove unnecessary time parsing in reconcile functions
#1831
pmokeev
closed
3 months ago
1
Add the glog libraries when build the vineyard llm cache module.
#1830
dashanji
closed
3 months ago
0
Fix bug of refcnt map.
#1829
vegetableysm
closed
3 months ago
0
Add block object id contained in global cache object to refcnt map
#1828
vegetableysm
closed
3 months ago
0
Complete the tryAcquireLock / tryReleaseLock of local meta server
#1827
vegetableysm
opened
3 months ago
1
Create llm cache block builder only when the user requests an update.
#1826
vegetableysm
opened
3 months ago
3
Bump up golang to 1.22 and fix the security issues
#1825
dashanji
opened
3 months ago
4
Bump up golint action to v4 and not specify a version
#1824
dashanji
closed
3 months ago
1
Bump google.golang.org/protobuf from 1.31.0 to 1.33.0 in /k8s
#1823
dependabot[bot]
closed
3 months ago
3
Fixes the compliation error under latest MacOS
#1822
sighingnow
closed
3 months ago
0
Disbale llm cache module while building vineyard-python-dev and vineyardd image.
#1821
dashanji
closed
3 months ago
0
Replace the vineyard+fluid example with a tutorial.
#1820
dashanji
closed
3 months ago
0
Replace Tensor and TensorBuilder with the KVTensor and KVTensorBuilder to delete the arrow deps.
#1819
dashanji
closed
3 months ago
2
Delete the tensor builder from vineyard llm kv cache to reduce the dependencies like arrow
#1818
dashanji
closed
3 months ago
0
The `import/export_kv_cache_buffer` show bad performance
#1817
dashanji
opened
3 months ago
1
improve the benchmark test of vineyard llm kv cache
#1816
dashanji
closed
1 month ago
1
Fix llm memory leak and replace mutex_lock with unique_lock
#1815
vegetableysm
closed
3 months ago
1
Use lock_guard or unique_lock to manager locks in llm module.
#1814
vegetableysm
closed
3 months ago
0
There exists memory leak in llm cache.
#1813
vegetableysm
closed
3 months ago
0
[GraphAr]: Support dumps subgraph to graphar
#1812
acezen
closed
3 months ago
0
Fix log error of radix tree deserialization.
#1811
vegetableysm
closed
3 months ago
0
When deserialize radix tree, it will show "Insert token list failed" error.
#1810
vegetableysm
closed
3 months ago
0
Support to put the data to the vineyardd instance with the most available memory
#1809
dashanji
closed
3 months ago
0
GraphAr: Support load and write subgraph to graphar with selected vertices/edges and properties
#1808
acezen
closed
3 months ago
1
Put object to the vineyardd with the least memory usage while the connected one is out of memory
#1807
dashanji
closed
3 months ago
0
Remove block objects from cache object meta to reduce the meta size.
#1806
vegetableysm
closed
3 months ago
1
Update the token list type from int* to vector<int> to avoid copying in radix tree.
#1805
dashanji
closed
4 months ago
0
Remove kv_state_cache_multi_test.cc
#1804
vegetableysm
closed
4 months ago
0
Add the python api for vineyard llm kv cache
#1803
dashanji
closed
3 months ago
1
Refactor radix tree to avoid memory copy.
#1802
vegetableysm
closed
4 months ago
0
Install the rax headers under the thirdparty directory.
#1801
dashanji
closed
4 months ago
0
llm-cache: cannot match incremental updates
#1800
sighingnow
closed
4 months ago
1
Add the vineyard directory for searching vineyard config file and support multiple rpc endpoints.
#1799
dashanji
closed
4 months ago
0
Refactor: API of KVStateCacheManager accept Client&.
#1798
vegetableysm
closed
4 months ago
1
Improve the query API of llm cache and use vector<uint8_t> as payload object.
#1797
dashanji
closed
4 months ago
0
Refactor llm cache and fix bug
#1796
vegetableysm
closed
4 months ago
0
llm-cache: use `vector<uint8_t>` as payload object and remove all assumption about double
#1795
sighingnow
closed
4 months ago
0
Change llm api return value to vineyard::Status.
#1794
vegetableysm
closed
4 months ago
1
llm-cache: document the public APIs
#1793
sighingnow
closed
2 months ago
1
llm-cache: avoid copying during query kv caches
#1792
sighingnow
closed
4 months ago
0
llm-cache: Use `vineyard:Status` as function results
#1791
sighingnow
closed
4 months ago
0
Add vineyard_llm_cache_tests target and don't install tests artifacts in ALL
#1790
sighingnow
closed
4 months ago
0
Fixes compilation failures with clang-19
#1789
sighingnow
closed
4 months ago
0
llm-cache: too many warnings under clang/clang++ (on MacOS)
#1788
sighingnow
closed
4 months ago
0
correct the install directory of llm-cache.
#1787
dashanji
closed
4 months ago
0
llm-cache: double check all usage of call-by-value of `std::vector<T>` and `std::shared_ptr<T>`
#1786
sighingnow
closed
4 months ago
0
incorrect cmake installation layout: llm-cache's things should be put to `/usr/local/include/vineyard/llm-cache/` folder
#1785
sighingnow
closed
4 months ago
0
refactor: `KVStateCacheManager` should accept `Client &` (note the reference) rather than connect inside the manager
#1784
sighingnow
closed
4 months ago
0
Previous
Next