Failing DataTest

[mjhanphd]

Hi I'm running the prebuilt docker container named "wav2letter/wav2letter:cuda-latest" When I ran "cd /root/wav2letter/src/build && make test" I got the error below:

(...)
97% tests passed, 1 tests failed out of 31

Total Test time (real) =  90.27 sec

The following tests FAILED:
          8 - DataTest (Failed)
Errors while running CTest

So I try "/root/wav2letter/build/src/tests/DataTest" and got the error below:

[==========] Running 4 tests from 2 test cases.
[----------] Global test environment set-up.
[----------] 3 tests from DataTest
[ RUN      ] DataTest.inputFeaturizer
[       OK ] DataTest.inputFeaturizer (4810 ms)
[ RUN      ] DataTest.targetFeaturizer
[       OK ] DataTest.targetFeaturizer (0 ms)
[ RUN      ] DataTest.W2lListDataset
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0229 07:22:32.664379  2481 W2lListFilesDataset.cpp:141] 3 files found.
I0229 07:22:32.664455  2481 Utils.cpp:102] Filtered 0/3 samples
I0229 07:22:32.664471  2481 W2lListFilesDataset.cpp:62] Total batches (i.e. iters): 3
[       OK ] DataTest.W2lListDataset (4 ms)
[----------] 3 tests from DataTest (4814 ms total)

[----------] 1 test from RoundRobinBatchShufflerTest
[ RUN      ] RoundRobinBatchShufflerTest.params
/root/wav2letter/src/data/test/DataTest.cpp:202: Failure
Value of: batches[0]
Expected: has 2 elements where
element #0 is equal to 8,
element #1 is equal to 9
  Actual: { 0, 1 }, whose element #0 doesn't match
[  FAILED  ] RoundRobinBatchShufflerTest.params (0 ms)
[----------] 1 test from RoundRobinBatchShufflerTest (0 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 2 test cases ran. (4814 ms total)
[  PASSED  ] 3 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] RoundRobinBatchShufflerTest.params

 1 FAILED TEST

Could anyone help me with this?

[tlikhomanenko]

@mjhanphd, this is known issue, we are working on it (fixing the test with respect to switching to another random generator in data loading). You can use this version of docker image, no any problem should be.

[mjhanphd]

@tlikhomanenko So you mean that it will work once I pull the latest commit again? Or new docker img?

[tlikhomanenko]

Test will fail, but this is only because we didn't fix the test itself right now after switching to another random generator in the dataset. I mean you can still use the docker image you tried, everything will be working correctly, this failed test doesn't affect any correctness of the code.

[mjhanphd]

Got it. Thank you so much :)