search

flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
760 stars 64 forks source link

bugfix: fix the scheduler behavior of large page size #333

Closed yzh119 closed 1 week ago

yzh119 commented 1 week ago

when 128 / page == 0, our binary search might run into division by zero issue.