search

fgnt / pb_chime5

Speech enhancement system for the CHiME-5 dinner party scenario
MIT License
109 stars 34 forks source link

`make` command take too long to finish #20

Closed vineelpratap closed 3 years ago

vineelpratap commented 3 years ago

Hi, I was trying to generate CHiME6 eval files using scripts from Kaldi and noticed that my script gets stuck at this stage .

 python -m pb_chime5.database.chime5.create_json -j cache/chime6.json -db kaldi/egs/chime6/s5_track1/CHiME6 --transcription-path kaldi/kaldi/egs/chime6/s5_track1/CHiME6/transcriptions --chime6

which is called from here https://github.com/kaldi-asr/kaldi/blob/master/egs/chime6/s5b_track1/local/decode.sh#L102

Do you have any estimate of how long is the make command supposed to take. And, if there are any ways to speed up the process.

For example, simply using more threads for make command using make -j80 cache/chime6.json doesn't seem to help...

Thanks in advance !

vineelpratap commented 3 years ago

We realized that it is because of some wierd MPI configs in my HPC cluster. Everything works now !

boeddeker commented 3 years ago

Hi,

I am glad, that you found a solution. A speedup for this function is difficult, but it should not take much time. That function creates the metadata, that is later used.