search

microsoft / vattention

Dynamic Memory Management for Serving LLMs without PagedAttention
MIT License
219 stars 14 forks source link

Update README files #8

Closed apanwariisc closed 3 months ago