search

georgepar / kaldi-grpc-server

Deploy Kaldi models using grpc for bidirectional streaming.
Apache License 2.0
17 stars 6 forks source link

Missing requirements #4

Open kosniaz opened 2 years ago

kosniaz commented 2 years ago

To be added:

software requirements

georgepar commented 2 years ago

What is the max workers value you pass? (https://github.com/georgepar/kaldi-grpc-server/blob/main/Makefile#L24)

10-15gb ram sounds a bit excessive

kosniaz commented 2 years ago

Turns out I was running with the defaults, i.e. max_workers=10. I switched to 3 workers and it didn't take much RAM. So, a rough estimation would be ~2GB*$max_workers

georgepar commented 2 years ago

TODO: Specify memory requirements as a function of num-workers and model size