Implement speculative caching.

Ai00-X / ai00_server

The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.

https://ai00-x.github.io/ai00_server/

MIT License

485 stars 58 forks source link

Closed cryscan closed 5 months ago