bugfix: fix sampler's implementation bug when dtype is not float32 - Githubissues

flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving

https://flashinfer.ai

Apache License 2.0

1.22k stars 115 forks source link

bugfix: fix sampler's implementation bug when dtype is not float32 #221

Closed yzh119 closed 5 months ago

yzh119 commented 5 months ago

Change 1 to DType(1)