Why does every test in the model, node and simple folders fail?

[abhinandanudupa]

I have compiled libonnx on a fresh installation of Ubuntu - installed all the prerequisites ran just make and tried running the tests one by one. But I find the every test that I run fails and I am not able to figure out why.

Here is what I did:

• Installed the latest LTS release of Ubuntu
• Installed make, build-essential, git and libsdl2-gfx (Did do other stuff but those would not mess with this)
• Ran make all to compile
• Ran the tests on many examples: ./tests ./model/mnist_8/
• But every test that I have tried has just failed!

  $ ./TESTING/libonnx/tests/tests ./TESTING/libonnx/tests/model/mnist_8/
  [test_data_set_0]                                                                       [FAIL]
  [test_data_set_1]                                                                       [FAIL]
  [test_data_set_2]                                                                       [FAIL]

• All those in the simple and model folders fail but those in pytorch-* succeed partially
• Is this because of a missing operator? (no Unsupported opset message has been displayed as in the pytorch tests)
• Nonetheless the example for handwriting recognition has identified the number correctly most of the time

[jianjunjiang]

usage:
    tests <DIRECTORY>
examples:
    tests ./tests/model
    tests ./tests/node
    tests ./tests/pytorch-converted
    tests ./tests/pytorch-operator
    tests ./tests/simple

~/libonnx/libonnx$ ./tests/tests ./tests/model
[mnist_8](test_data_set_0)                                                              [OKAY]
[mnist_8](test_data_set_1)                                                              [OKAY]
[mnist_8](test_data_set_2)                                                              [OKAY]
[mobilenet_v2_7](test_data_set_0)                                                       [OKAY]
[mobilenet_v2_7](test_data_set_1)                                                       [OKAY]
[mobilenet_v2_7](test_data_set_2)                                                       [OKAY]
[shufflenet_v1_9](test_data_set_0)                                                      [OKAY]
[shufflenet_v1_9](test_data_set_1)                                                      [OKAY]
[shufflenet_v1_9](test_data_set_2)                                                      [OKAY]
[squeezenet_v11_7](test_data_set_0)                                                     [OKAY]
[squeezenet_v11_7](test_data_set_1)                                                     [OKAY]
[squeezenet_v11_7](test_data_set_2)                                                     [OKAY]
[super_resolution_10](test_data_set_0)                                                  [OKAY]
[tinyyolo_v2_8](test_data_set_0)                                                        [OKAY]

[abhinandanudupa]

Update: Running ./libonnx/tests/tests ./libonnx/tests/model/$(wildcard *) will give the required output:

wildcard: command not found
[mnist_8](test_data_set_0)                                                              [OKAY]
[mnist_8](test_data_set_1)                                                              [OKAY]
[mnist_8](test_data_set_2)                                                              [OKAY]
[mobilenet_v2_7](test_data_set_0)                                                       [OKAY]
[mobilenet_v2_7](test_data_set_1)                                                       [OKAY]
[mobilenet_v2_7](test_data_set_2)                                                       [OKAY]
[shufflenet_v1_9](test_data_set_0)                                                      [OKAY]
[shufflenet_v1_9](test_data_set_1)                                                      [OKAY]
[shufflenet_v1_9](test_data_set_2)                                                      [OKAY]
[squeezenet_v11_7](test_data_set_0)                                                     [OKAY]
[squeezenet_v11_7](test_data_set_1)                                                     [OKAY]
[squeezenet_v11_7](test_data_set_2)                                                     [OKAY]
[super_resolution_10](test_data_set_0)                                                  [OKAY]
[tinyyolo_v2_8](test_data_set_0)                                                        [OKAY]
[tinyyolo_v2_8](test_data_set_1)                                                        [OKAY]
[tinyyolo_v2_8](test_data_set_2)                                                        [OKAY]

Why is this so? Can you explain?

Little did I realise that wildcard was a make function and not a bash function.