Closed github-actions[bot] closed 1 week ago
forward_return_lse
BatchPrefillWithRaggedKVCache
logits_soft_cap
kv_chunk_size
This PR was generated with Release Please. See documentation.
:robot: Release is at https://github.com/flashinfer-ai/flashinfer/releases/tag/v0.0.7 :sunflower:
:robot: I have created a release beep boop
0.0.7 (2024-06-28)
Bugfix
forward_return_lse
function inBatchPrefillWithRaggedKVCache
class (#337)Features
logits_soft_cap
value (#339) (a2498f5)Performance Improvements
kv_chunk_size
back to 128 (#329) (f237f5f)This PR was generated with Release Please. See documentation.