fmetze
commented
6 years ago Can you check if the features have been created correctly in the regular file system, and if they have been copied correctly to the local scratch file systems? It almost looks like you are trying to read a matrix that has 0 dimensions, often a sign of a corrupt file.
On Dec 5, 2017, at 1:38 AM, Lontong Balap notifications@github.com wrote:
Hi Alls
I already install essen and I want to try to run the librispeech recipe. I got an error: EPOCH 1 RUNNING ... TAG: 10_1.0 lrate 4e-05, steps/train_ctc_parallel_mult.sh: line 201: 28490 Aborted $train_tool --report-step=$report_step --num-sequence=$num_sequence --frame-limit=$frame_num_limit --learn-rate=$learn_rate --momentum=$momentum --verbose=$verbose "$feats_tr" "$labels_tr" $dir/nnet/nnet.iter$[iter-1] $dir/nnet/nnet.iter${iter} 1>&$dir/log/tr.iter$iter.log
and the last line of tr.iter1.log: WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 5652-39938-0029, missing targets WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 3699-47246-0007, missing targets WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 298-126791-0067, missing targets LOG (apply-cmvn:main():apply-cmvn.cc:129) Applied cepstral mean and variance normalization to 27089 utterances, errors on 0 WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 5652-39938-0025, missing targets WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 7859-102521-0017, missing targets LOG (subsample-feats:main():subsample-feats.cc:115) Processed 27089 feature matrices; 0 with errors. LOG (subsample-feats:main():subsample-feats.cc:117) Processed 34358484 input frames and 11452754 output frames. KALDIASSERT: at train-ctc-parallel:Init:matrix.cc:505, failed: rows == 0 && cols == 0 Stack trace is: eesen::KaldiGetStackTrace[abi:cxx11]() eesen::KaldiAssertFailure(char const, char const, int, char const*) eesen::Matrix
::Init(int, int) eesen::Matrix ::Resize(int, int, eesen::MatrixResizeType) eesen::Matrix ::Matrix(int, int, eesen::MatrixResizeType) train-ctc-parallel(main+0x12ab) [0x4a7d0d] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f2a1330d830] train-ctc-parallel(_start+0x29) [0x4a5439] thank you
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/srvk/eesen/issues/161, or mute the thread https://github.com/notifications/unsubscribe-auth/AEnA8aio_04IfS3973AZ41Pd2h3AR1qXks5s9QEQgaJpZM4Q160N.
Florian Metze http://www.cs.cmu.edu/directory/florian-metze Associate Research Professor Carnegie Mellon University
icestoneking
Hi Alls
I already install essen and I want to try to run the librispeech recipe. I got an error:
EPOCH 1 RUNNING ... TAG: 10_1.0 lrate 4e-05, steps/train_ctc_parallel_mult.sh: line 201: 28490 Aborted $train_tool --report-step=$report_step --num-sequence=$num_sequence --frame-limit=$frame_num_limit --learn-rate=$learn_rate --momentum=$momentum --verbose=$verbose "$feats_tr" "$labels_tr" $dir/nnet/nnet.iter$[iter-1] $dir/nnet/nnet.iter${iter} 1>&$dir/log/tr.iter$iter.logand the last line of tr.iter1.log:
WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 5652-39938-0029, missing targets WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 3699-47246-0007, missing targets WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 298-126791-0067, missing targets LOG (apply-cmvn:main():apply-cmvn.cc:129) Applied cepstral mean and variance normalization to 27089 utterances, errors on 0 WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 5652-39938-0025, missing targets WARNING (train-ctc-parallel:main():train-ctc-parallel.cc:153) 7859-102521-0017, missing targets LOG (subsample-feats:main():subsample-feats.cc:115) Processed 27089 feature matrices; 0 with errors. LOG (subsample-feats:main():subsample-feats.cc:117) Processed 34358484 input frames and 11452754 output frames. KALDI_ASSERT: at train-ctc-parallel:Init:matrix.cc:505, failed: rows == 0 && cols == 0 Stack trace is: eesen::KaldiGetStackTrace[abi:cxx11]() eesen::KaldiAssertFailure_(char const*, char const*, int, char const*) eesen::Matrix<float>::Init(int, int) eesen::Matrix<float>::Resize(int, int, eesen::MatrixResizeType) eesen::Matrix<float>::Matrix(int, int, eesen::MatrixResizeType) train-ctc-parallel(main+0x12ab) [0x4a7d0d] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7f2a1330d830] train-ctc-parallel(_start+0x29) [0x4a5439]thank you