Open kosniaz opened 2 years ago
What is the max workers value you pass? (https://github.com/georgepar/kaldi-grpc-server/blob/main/Makefile#L24)
10-15gb ram sounds a bit excessive
Turns out I was running with the defaults, i.e. max_workers=10. I switched to 3 workers and it didn't take much RAM. So, a rough estimation would be ~2GB*$max_workers
TODO: Specify memory requirements as a function of num-workers and model size
To be added:
software requirements
hardware requirements