search

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Apache License 2.0
653 stars 31 forks source link

Fix backend #81

Closed chenht2022 closed 1 week ago

chenht2022 commented 1 week ago

Fix busy waiting problem.