flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving
https://flashinfer.ai
Apache License 2.0
1.22k stars 115 forks source link

[TVMWrapper] Add wrapper functions for sampler #215

Closed MasterJH5574 closed 5 months ago

MasterJH5574 commented 5 months ago

This commit adds the wrapper functions for sampling functions.