search

kaldi-asr / kaldi

kaldi-asr/kaldi is the official location of the Kaldi project.
http://kaldi-asr.org
Other
13.95k stars 5.29k forks source link

Pytorchnn support multi-gpus #4468

Open yzmyyff opened 3 years ago

yzmyyff commented 3 years ago

Pytorchnn only uses one gpu. It's very inefficient when training a large amount of text.

kkm000 commented 2 years ago

This is a Kaldi repository. Whet do you mean? K2 is here, btw: https://github.com/k2-fsa/k2.

yzmyyff commented 2 years ago

Please see codes in wsj local/pytorchnn. It's another nnlm rescore backend.

kkm000 commented 2 years ago

My best guess is that it's not implemented. A PR is welcome.

@keli78, do you have something to add?

keli78 commented 2 years ago

@kkm000 Right, we don't have a multi-gpu implementation. I'm afraid I'm not available to add it currently. It will be great if you would like to take it.

kkm000 commented 2 years ago

@keli78, I'm not up to the task. There is too much work undone on Kaldi that my plate is full, and I have a dayjob (although they do intersect a lot).

@yzmyyff, if you want to develop it, that would be very welcome!

yzmyyff commented 2 years ago

I'm sorry that I am not in this direction now.

The conclusion of the previous attempt is that it will obviously reduce server throughput.

So keeping the existing status is enough for me.