search

flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
1.1k stars 98 forks source link

example: add example of using BatchPrefillWithRaggedKVCacheWrapper c++ api #190

Closed yzh119 closed 5 months ago

yzh119 commented 5 months ago

Per request in issue #189