flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
1.1k stars 98 forks source link

refactor: unify dispatch scheme #183

Closed yzh119 closed 5 months ago

yzh119 commented 5 months ago

We used to mix use two different styles of dispatch mode, in this PR we refactor the codebase to use a unified dispatch scheme.