search

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Apache License 2.0
741 stars 39 forks source link

Use cond var to avoid busy loop #83

Closed sayap closed 1 month ago

sayap commented 2 months ago

Fix #80

UnicornChan commented 2 months ago

I will merge the code after completing the tests on the Windows platform.