flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
760 stars 64 forks source link

refactor: simplify kernel interface #312

Closed yzh119 closed 2 weeks ago

yzh119 commented 2 weeks ago

We don't need to separate between tmp_v/o and tmp_s/lse in kernel arguments