meeting a problem with sctk when 'make' in the path 'kaldi/tools'

[MrDavidG]

When installing the kaldi as kaldi/tools/INSTALL, I typed sudo make and met the following problem:

extras/check_dependencies.sh
extras/check_dependencies.sh: all OK.
tar xojf sctk-2.4.10-20151007-1312Z.tar.bz2 || \
      tar --exclude '*NONE*html' -xvojf sctk-2.4.10-20151007-1312Z.tar.bz2

bzip2: Compressed file ends unexpectedly;
    perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
    Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now
sctk-2.4.10/
sctk-2.4.10/bin/
sctk-2.4.10/CHANGELOG
sctk-2.4.10/DISCLAIMER
sctk-2.4.10/doc/
sctk-2.4.10/INSTALL
...
sctk-2.4.10/src/asclite/testfiles/scliteCompatTestOutDir/CT-trn-i-x-x.sgml
sctk-2.4.10/src/asclite/testfiles/scliteCompatTestOutDir/CT-trn-s-F-D.sgml
sctk-2.4.10/src/asclite/testfiles/scliteCompatTestOutDir/CT-trn-s-F-x.sgml
sctk-2.4.10/src/asclite/testfiles/scliteCompatTestOutDir/CT-trn-s-x-D.sgml
sctk-2.4.10/src/asclite/testfiles/scliteCompatTestOutDir/CT-trn-s-x-x.sgml
sctk-2.4.10/src/asclite/testfiles/ascliteTestOutDir/CT-mdm-full-i-F-D-ov1.sgml

bzip2: Compressed file ends unexpectedly;
    perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
    Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

tar: Unexpected EOF in archive
tar: Unexpected EOF in archive
tar: Error is not recoverable: exiting now
Makefile:109: recipe for target 'sctk' failed
make: *** [sctk] Error 2

How can I deal with the problem?

[kkm000]

tar xojf sctk-2.4.10-20151007-1312Z.tar.bz2 || \
      tar --exclude '*NONE*html' -xvojf sctk-2.4.10-20151007-1312Z.tar.bz2

bzip2: Compressed file ends unexpectedly;

The tarball sctk-2.4.10-20151007-1312Z.tar.bz2 was not downloaded correctly, apparently cut short while downloading. Try deleting it and rerunning make, before anything else.

[kkm000]

This is where the file is downloaded: https://github.com/kaldi-asr/kaldi/blob/76bdf206f2f988d84c6aa885acbb24c33f05e75b/tools/Makefile#L113-L115

I just verified that both are in fact ok:

~$ wget -T 10 -t 3 ftp://jaguar.ncsl.nist.gov/pub/sctk-2.4.10-20151007-1312Z.tar.bz2
--2019-04-08 08:42:21--  ftp://jaguar.ncsl.nist.gov/pub/sctk-2.4.10-20151007-1312Z.tar.bz2
           => ‘sctk-2.4.10-20151007-1312Z.tar.bz2’
 . . . .
2019-04-08 08:42:23 (1.97 MB/s) - ‘sctk-2.4.10-20151007-1312Z.tar.bz2’ saved [2008966]
~$ tar jxf sctk-2.4.10-20151007-1312Z.tar.bz2
~$ ls sctk-2.4.10
CHANGELOG  DISCLAIMER  INSTALL  README  bin  doc  makefile  src
~$ sha1sum sctk-2.4.10-20151007-1312Z.tar.bz2
996538dca0ae9a5a06a92fa8ed7eb68e5304d369  sctk-2.4.10-20151007-1312Z.tar.bz2
~$ rm -rf sctk-2.4.10/ sctk-2.4.10-20151007-1312Z.tar.bz2
~$ wget --no-check-certificate -T 10 http://www.openslr.org/resources/4/sctk-2.4.10-20151007-1312Z.tar.bz2
--2019-04-08 08:48:31--  http://www.openslr.org/resources/4/sctk-2.4.10-20151007-1312Z.tar.bz2
 . . . 
2019-04-08 08:48:32 (1.46 MB/s) - ‘sctk-2.4.10-20151007-1312Z.tar.bz2’ saved [2008966/2008966]
~$ sha1sum sctk-2.4.10-20151007-1312Z.tar.bz2
996538dca0ae9a5a06a92fa8ed7eb68e5304d369  sctk-2.4.10-20151007-1312Z.tar.bz2

Both files are identical at the source, and both can be downloaded. Looks like a download hiccup. You can download the file and unpack it by hand as I did above, so you know it's ok; make should not try to "remake" it if it exists. Refer to the checksum and file length (2008966) above to double-check you have a complete download.

[kkm000]

One more thing. From your log

extras/check_dependencies.sh: all OK.
tar xojf sctk-2.4.10-20151007-1312Z.tar.bz2 || \
      tar --exclude '*NONE*html' -xvojf sctk-2.4.10-20151007-1312Z.tar.bz2

There is no wget output right before tar. This means make did not try to "make" it, because the tarball file had already been found in the directory. You possibly have more stale stuff than just this one fiile there, make clean first to be safe.

[danpovey]

Kirill, I sent you a couple emails about broken builds, to your smartaction email, not sure if it is the right one? Please fix it as soon as you can!

On Mon, Apr 8, 2019 at 6:03 AM kkm (aka Kirill Katsnelson) < notifications@github.com> wrote:

One more thing. From your log

extras/check_dependencies.sh: all OK. tar xojf sctk-2.4.10-20151007-1312Z.tar.bz2 || \ tar --exclude 'NONEhtml' -xvojf sctk-2.4.10-20151007-1312Z.tar.bz2

There is no wget output right before tar. This means make did not try to "make" it, because the tarball file had already been found in the directory. You possibly have more stale stuff than just this one fiile there, make clean first to be safe.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kaldi-asr/kaldi/issues/3214#issuecomment-480894523, or mute the thread https://github.com/notifications/unsubscribe-auth/ADJVu8uhDzyWjqqgisJuUHsU0rYmohcEks5ve2g1gaJpZM4chgNj .

[A-Raafat]

You have to extract it manually, because the name of SCTK in the makefile needs to be changed. this means the make file doesnt see it