search

flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
760 stars 64 forks source link

bugfix: fix the `forward_return_lse` function in `BatchPrefillWithRaggedKVCache` class #337

Closed yzh119 closed 1 week ago

yzh119 commented 1 week ago

Add more tests for coverage.