search

alphacep / vosk-server

WebSocket, gRPC and WebRTC speech recognition server based on Vosk and Kaldi libraries
Apache License 2.0
871 stars 241 forks source link

grpc/stt_server.py: use env to configure threads/queueing #226

Closed robfig closed 1 year ago

robfig commented 1 year ago

I'd like to support 5*cores or 10*cores concurrent streams. Limited testing seemed to demonstrate that it was possible -- I ran vosk-server with --cpuset-cpus=0 and 10 concurrent streams sending in a 20s wav file. There may have been some additional delay, but it generally seems to have worked.

nshmyrev commented 1 year ago

Thanks a lot!

robfig commented 1 year ago

Thanks for the quick response! Out of curiosity, any idea when this will make it into dockerhub?

(Just wondering if I should set up a personal image repository in the meantime)