flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
1.22k stars 115 forks source link

Fix implicit cast in sampling #224

Closed abcdabcd987 closed 5 months ago