search

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Apache License 2.0
741 stars 39 forks source link

Fix backend #81

Closed chenht2022 closed 2 months ago

chenht2022 commented 2 months ago

Fix busy waiting problem.