search

kaldi-asr / kaldi

kaldi-asr/kaldi is the official location of the Kaldi project.
http://kaldi-asr.org
Other
14.25k stars 5.32k forks source link

Meet an error when making /src #4748

Closed ForNovsta closed 2 years ago

ForNovsta commented 2 years ago

I am a starter for kaldi and was installing kaldi on my virtual machine with ubuntu-20.04.2.0 system and met an error when making the /src. The report is

image

(没有那个文件或目录 = no such file or dictionary, 错误 = error)

It seems like I am lack of a file called libkaldi-online2.so, but I searched it and cannot find it anywhere in my virtual machine. I followed the instructions written in INSTALL documents, everything went fine until this error was raised. What should I do to deal with this? Thanks for everyone who helps me.

jtrmal commented 2 years ago

there was probably some error before tihs error y.

On Thu, May 26, 2022 at 2:07 AM ForNovsta @.***> wrote:

I am a starter for kaldi and was installing kaldi on my virtual machine with ubuntu-20.04.2.0 system and met an error when making the /src. The report is

[image: image] https://user-images.githubusercontent.com/75245033/170425968-04241f7e-8fd7-4fd2-a245-279b8ae0d70a.png

(没有那个文件或目录 = no such file or dictionary, 错误 = error)

It seems like I am lack of a file called libkaldi-online2.so, but I searched it and cannot find it anywhere in my virtual machine. I followed the instructions written in INSTALL documents, everything went fine until this error was raised. What should I do to deal with this? Thanks for everyone who helps me.

— Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4748, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYXYKMWMZK7QBEB7KRU3VL4IKNANCNFSM5W7WU4VA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

ForNovsta commented 2 years ago

That's so bad. Is this error related to the make of /tools since it is complated before making /src? Or just something went wrong when making /src? Would it help if I remake it?

there was probably some error before tihs error y. … On Thu, May 26, 2022 at 2:07 AM ForNovsta @.> wrote: I am a starter for kaldi and was installing kaldi on my virtual machine with ubuntu-20.04.2.0 system and met an error when making the /src. The report is [image: image] https://user-images.githubusercontent.com/75245033/170425968-04241f7e-8fd7-4fd2-a245-279b8ae0d70a.png (没有那个文件或目录 = no such file or dictionary, 错误 = error) It seems like I am lack of a file called libkaldi-online2.so, but I searched it and cannot find it anywhere in my virtual machine. I followed the instructions written in INSTALL documents, everything went fine until this error was raised. What should I do to deal with this? Thanks for everyone who helps me. — Reply to this email directly, view it on GitHub <#4748>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYXYKMWMZK7QBEB7KRU3VL4IKNANCNFSM5W7WU4VA . You are receiving this because you are subscribed to this thread.Message ID: @.>

csukuangfj commented 2 years ago

I would recommend you to post the commands you used and also post more logs to give us a better context.

ForNovsta commented 2 years ago

Well unfortunately I have closed the terminal and don't know how to find the logs back, but I can tell you the commands I used if it helps. Firstly I used git clone https://github.com/kaldi-asr/kaldi.git Then I went kaldi/tools and ran extras/check_dependencies.sh and it reported that I am ready to make tools, then I used command make and waiting for several hours until it reported all done. Then I went kaldi/src and use ./configure --shared and it said I am ready to make src. As it instructed I used command make depend, after it was over, I used command make and waiting for another several hours until the error I have posted was raised. I am going to remake the src if the report logs really matters and after several hours I could post the logs here.

I would recommend you to post the commands you used and also post more logs to give us a better context.

csukuangfj commented 2 years ago

If you have several CPU cores, e.g, 8 cores, you can use

make -j 8

to reduce the compilation time.

jtrmal commented 2 years ago

this will cause the error to be buried somewhere where I'm not confident they will be able to find it.

On Thu, May 26, 2022 at 8:41 AM Fangjun Kuang @.***> wrote:

If you have several CPU cores, e.g, 8 cores, you can use

make -j 8

to reduce the compilation time.

— Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4748#issuecomment-1138535361, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYXZ4TXIYCZGA6JL5XC3VL5WOTANCNFSM5W7WU4VA . You are receiving this because you commented.Message ID: @.***>

jtrmal commented 2 years ago

I had a good reason to suggest -j 1 y.

On Thu, May 26, 2022 at 8:41 AM Jan Yenda Trmal @.***> wrote:

this will cause the error to be buried somewhere where I'm not confident they will be able to find it.

On Thu, May 26, 2022 at 8:41 AM Fangjun Kuang @.***> wrote:

If you have several CPU cores, e.g, 8 cores, you can use

make -j 8

to reduce the compilation time.

— Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4748#issuecomment-1138535361, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYXZ4TXIYCZGA6JL5XC3VL5WOTANCNFSM5W7WU4VA . You are receiving this because you commented.Message ID: @.***>

ForNovsta commented 2 years ago

The virtual machine only provides one CPU, so I could not use this method to accelerate :-(

If you have several CPU cores, e.g, 8 cores, you can use

make -j 8

to reduce the compilation time.

ForNovsta commented 2 years ago

Did the commands I have used have something unproper? The make of /src takes really long time, so if something besides it went wrong please tell me so I can repair it now.

csukuangfj commented 2 years ago

You can use

make -j1 2>&1 | tee make-log.txt

and post make-log.txt.

No. Your commands look OK, I think.

ForNovsta commented 2 years ago

OK, then I would remake the src and post the log here. Thanks you guys for helping me.

ForNovsta commented 2 years ago

After several hours' make, finally it #ended with the same error and here is the log, make-log.txt Hope it could say something that helps.

You can use

make -j1 2>&1 | tee make-log.txt

and post make-log.txt.

No. Your commands look OK, I think.

csukuangfj commented 2 years ago

I confirm that the issue is reproducible, which is introduced by #4744, I think.

That PR removes the following lines from src/Makefile:

# this is necessary for correct parallel compilation
#1) The tools depend on all the libraries (which is a nonsense)
bin chainbin featbin fgmmbin fstbin gmmbin ivectorbin \
    kwsbin latbin lmbin nnet2bin nnet3bin nnetbin online2bin rnnlmbin : \
 $(BMU) chain cudamatrix decoder feat fstext gmm hmm ivector \
        kws lat lm nnet nnet2 nnet3 online2 rnnlm transform tree

which is the cause of this issue.

4637 added online2 as a dependency for nnet3bin but #4744 removes it.

Should be fixed by #4749

ForNovsta commented 2 years ago

Thanks a lot, and should I redo the whole installation process or just fix the src/Makefile?

I confirm that the issue is reproducible, which is introduced by #4744, I think.

That PR removes the following lines from src/Makefile:

# this is necessary for correct parallel compilation
#1) The tools depend on all the libraries (which is a nonsense)
bin chainbin featbin fgmmbin fstbin gmmbin ivectorbin \
    kwsbin latbin lmbin nnet2bin nnet3bin nnetbin online2bin rnnlmbin : \
 $(BMU) chain cudamatrix decoder feat fstext gmm hmm ivector \
        kws lat lm nnet nnet2 nnet3 online2 rnnlm transform tree

which is the cause of this issue.

4637 added online2 as a dependency for nnet3bin but #4744 removes it.

Should be fixed by #4749

csukuangfj commented 2 years ago

Thanks a lot, and should I redo the whole installation process or just fix the src/Makefile?

Just fix the Makefile should work. No need to clean&make

ForNovsta commented 2 years ago

Well, then how should I fix the Makefile, should I insert your code to somewhere in the file? Or replace something?

Thanks a lot, and should I redo the whole installation process or just fix the src/Makefile?

Just fix the Makefile should work. No need to clean&make

csukuangfj commented 2 years ago

Just replace https://github.com/kaldi-asr/kaldi/blob/1a233a11db0b28aa4966a4e271c839c135de5914/src/Makefile#L191 with https://github.com/kaldi-asr/kaldi/blob/c8d91148eb31eba191c89c16862532ba12b36eb8/src/Makefile#L191

ForNovsta commented 2 years ago

Get it. I would report if I were successful or not as soon as the result come out.

Just replace

https://github.com/kaldi-asr/kaldi/blob/1a233a11db0b28aa4966a4e271c839c135de5914/src/Makefile#L191

with https://github.com/kaldi-asr/kaldi/blob/c8d91148eb31eba191c89c16862532ba12b36eb8/src/Makefile#L191

ForNovsta commented 2 years ago

With the fix the make is successful, thanks.

jtrmal commented 2 years ago

no, probably in the src make... just run make -j 1 again -- the -j 1 is important in this case y.

On Thu, May 26, 2022 at 8:14 AM ForNovsta @.***> wrote:

That's so bad. Is this error related to the make of /tools since it is complated before making /src? Or just something went wrong when making /src? Would it help if I remake it?

there was probably some error before tihs error y. … <#m6513803546660151226> On Thu, May 26, 2022 at 2:07 AM ForNovsta @.> wrote: I am a starter for kaldi and was installing kaldi on my virtual machine with ubuntu-20.04.2.0 system and met an error when making the /src. The report is [image: image] https://user-images.githubusercontent.com/75245033/170425968-04241f7e-8fd7-4fd2-a245-279b8ae0d70a.png https://user-images.githubusercontent.com/75245033/170425968-04241f7e-8fd7-4fd2-a245-279b8ae0d70a.png (没有那个文件或目录 = no such file or dictionary, 错误 = error) It seems like I am lack of a file called libkaldi-online2.so, but I searched it and cannot find it anywhere in my virtual machine. I followed the instructions written in INSTALL documents, everything went fine until this error was raised. What should I do to deal with this? Thanks for everyone who helps me. — Reply to this email directly, view it on GitHub <#4748 https://github.com/kaldi-asr/kaldi/issues/4748>, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYXYKMWMZK7QBEB7KRU3VL4IKNANCNFSM5W7WU4VA https://github.com/notifications/unsubscribe-auth/ACUKYXYKMWMZK7QBEB7KRU3VL4IKNANCNFSM5W7WU4VA . You are receiving this because you are subscribed to this thread.Message ID: @.>

— Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/4748#issuecomment-1138504960, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACUKYX6JV4O4MGMI25H5WRLVL5TKFANCNFSM5W7WU4VA . You are receiving this because you commented.Message ID: @.***>