Closed yzh119 closed 1 month ago
add fix the bugs in single_prefill_with_kv_cache and single_prefill_with_kv_cache_return_lse when using mask.
single_prefill_with_kv_cache
single_prefill_with_kv_cache_return_lse
add fix the bugs in
single_prefill_with_kv_cacheandsingle_prefill_with_kv_cache_return_lsewhen using mask.