search

v6d-io / v6d

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)
https://v6d.io
Apache License 2.0
829 stars 122 forks source link

Implement the hash matching of prompt prefix in vineyard llm kv cache #1832

Closed dashanji closed 5 months ago

dashanji commented 6 months ago

Describe your problem