flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
760 stars 64 forks source link

tests: add more unittests for logits cap #352

Closed yzh119 closed 2 days ago

yzh119 commented 2 days ago

followup of #350 add the case of logits_soft_case=1.0 to correctness tests. add batch decode/prefill tests.