michaelfeil / infinity

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
https://michaelfeil.github.io/infinity/
MIT License
1.47k stars 114 forks source link

extract audio code in audio utils. Update README #379

Closed wirthual closed 1 month ago

wirthual commented 1 month ago

Follow up changes for the CLAP functionality

michaelfeil commented 1 month ago

@wirthual Thanks a lot for your contributions! Seems like I ran in some concurrency issues working on the same issues as you were. I just refactored the requests section into async requests.

Happy to use a similar, if its based on the latest main

wirthual commented 1 month ago

Your as fast as your server ;) Let me open a new PR