search

clang-omp / clang

clang with OpenMP 3.1 and some elements of OpenMP 4.0 support
clang-omp.github.com
Other
91 stars 15 forks source link

Validation suite results differs from that reported on the homepage #41

Closed pysuxing closed 10 years ago

pysuxing commented 10 years ago

The validation suite results reported on clang-omp's homepage says that

OpenMP Validation Suite by OpenUH Research Compiler - passed 119 tests of 123

But on my machine, only 118 test are passed, one less than reported above. I want to figure out which test failed unexpectly, so could anyone attach validation results with 119 passed tests here?

thanks!

--------------------------------- my results.txt ---------------------------

#Tested Directive           t   ct  ot  oct
has_openmp                  100 100 100 100
omp_atomic                  100 95  100 85
omp_barrier                 100 100 100 100
omp_critical                100 0   100 15
omp_flush                   100 100 100 100
omp_for_firstprivate        100 100 100 100
omp_for_lastprivate         100 100 100 85
omp_for_ordered             100 100 100 100
omp_for_private             100 100 100 100
omp_for_reduction           100 100 100 100
omp_for_schedule_dynamic    100 100 100 100
omp_for_schedule_guided     100 100 100 100
omp_for_schedule_static     100 100 100 100
omp_for_nowait              100 100 100 100
omp_get_num_threads         100 100 100 100
omp_get_wtick               100 100 100 100
omp_get_wtime               100 100 100 100
omp_in_parallel             100 100 100 100
omp_lock                    100 100 100 100
omp_master                  100 100 100 100
omp_nest_lock               100 100 100 100
omp_parallel_copyin         100 100 100 100
omp_parallel_for_firstprivate   100 100 100 100
omp_parallel_for_lastprivate    100 100 100 100
omp_parallel_for_ordered    100 100 100 100
omp_parallel_for_private    100 100 100 100
omp_parallel_for_reduction  100 100 100 100
omp_parallel_num_threads    100 100 100 100
omp_parallel_sections_firstprivate  100 100 100 100
omp_parallel_sections_lastprivate   100 100 100 100
omp_parallel_sections_private   100 100 100 100
omp_parallel_sections_reduction     100 15  100 10
omp_section_firstprivate    100 100 100 100
omp_section_lastprivate     100 100 100 100
omp_section_private         100 100 100 100
omp_sections_reduction      100 30  100 45
omp_sections_nowait         100 100 100 100
omp_parallel_for_if         100 100 100 100
omp_single_copyprivate      100 100 100 100
omp_single_nowait           100 100 100 100
omp_single_private          100 100 100 100
omp_single                  100 100 100 100
omp_test_lock               100 100 100 100
omp_test_nest_lock          100 100 100 100
omp_threadprivate           100 100 -   -

omp_parallel_default        100 100 100 100
omp_parallel_shared         100 100 100 100
omp_parallel_private        100 100 100 100
omp_parallel_firstprivate   100 100 100 100
omp_parallel_if             100 100 100 100
omp_parallel_reduction      100 100 100 100
omp_for_collapse            100 100 100 100
omp_master_3                100 100 100 100
omp_task                    100 100 100 100
omp_task_if                 100 100 100 100
omp_task_untied             0   -   0   -
omp_task_shared             100 100 100 100
omp_task_private            100 100 100 100
omp_task_firstprivate       100 100 100 100
omp_taskwait                100 100 100 100
omp_taskyield               100 139 10  -
omp_task_final              0   -   0   -
pysuxing commented 10 years ago

The failing tests are for three OpenMP constructs: _omp_taskuntied, _omptaskyield, _omp_taskfinal. The notable failure is from _omptaskyield that the normal test succeed with a segment fault, and the orphaned failed 90% of the tests.

I wonder if it's the test result of _omptaskyield that differs from the official report.

----------------------- results of the failing test --------------------------------

    Testing for "omp_task_untied":
    Generating sources .............. success
    Compiling soures ................ success
    Running test with 8 threads ..... failed 100% of the tests
    + orphaned mode:
    Generating sources .............. success
    Compiling soures ................ success
    Running test with 8 threads ..... failed 100% of the tests

    #Tested Directive           t     ct     ot   oct
    omp_task_untied             0     -      0    -

    Summary:
    S Number of tested Open MP constructs: 1
    S Number of used tests:                2
    S Number of failed tests:              2
    S Number of successful tests:          0
    S + from this were verified:           0

    Normal tests:
    N Number of failed tests:              1
    N + from this fail compilation:        0
    N + from this timed out                0
    N Number of successful tests:          0
    N + from this were verified:           0

    Orphaned tests:
    O Number of failed tests:              1
    O + from this fail compilation:        0
    O + from this timed out                0
    O Number of successful tests:          0
    O + from this were verified:           0

    Testing for "omp_taskyield":
    Generating sources .............. success
    Compiling soures ................ success
    Running test with 8 threads ..... success ...Segmentation fault
    ... and verified with 139% certainty
    + orphaned mode:
    Generating sources .............. success
    Compiling soures ................ success
    Running test with 8 threads ..... failed 90% of the tests

    #Tested Directive           t     ct     ot  oct
    omp_taskyield               100   139    10  -

    Summary:
    S Number of tested Open MP constructs: 1
    S Number of used tests:                2
    S Number of failed tests:              1
    S Number of successful tests:          1
    S + from this were verified:           0

    Normal tests:
    N Number of failed tests:              0
    N + from this fail compilation:        0
    N + from this timed out                0
    N Number of successful tests:          1
    N + from this were verified:           0

    Orphaned tests:
    O Number of failed tests:              1
    O + from this fail compilation:        0
    O + from this timed out                0
    O Number of successful tests:          0
    O + from this were verified:           0

    Testing for "omp_task_final":
    Generating sources .............. success
    Compiling soures ................ success
    Running test with 8 threads ..... failed 100% of the tests
    + orphaned mode:
    Generating sources .............. success
    Compiling soures ................ success
    Running test with 8 threads ..... failed 100% of the tests

    #Tested Directive           t     ct     ot   oct
    omp_task_final              0     -      0    -

    Summary:
    S Number of tested Open MP constructs: 1
    S Number of used tests:                2
    S Number of failed tests:              2
    S Number of successful tests:          0
    S + from this were verified:           0

    Normal tests:
    N Number of failed tests:              1
    N + from this fail compilation:        0
    N + from this timed out                0
    N Number of successful tests:          0
    N + from this were verified:           0

    Orphaned tests:
    O Number of failed tests:              1
    O + from this fail compilation:        0
    O + from this timed out                0
    O Number of successful tests:          0
    O + from this were verified:           0
alexey-bataev commented 10 years ago

Hi, Yes, there was the bug in runtime library with the taskyield test, but it should be fixed already. Try the latest version of OpenMP runtime from openmp.llvm.org.

Best regards,

Alexey Bataev

Software Engineer Intel Compiler Team Intel Corp.

16.08.2014 12:09, SuXing пишет:

The failing tests are for three OpenMP constructs: /omp_task_untied/, /omp_taskyield/, /omp_task_final/. The notable failure is from /omp_taskyield/ that the normal test succeed with a segment fault, and the orphaned failed 90% of the tests.

I wonder if the my test result of /omp_taskyield/ is different from the official report.

----------------------- results of the failing test

| Testing for "omp_task_untied": Generating sources .............. success Compiling soures ................ success Running test with 8 threads ..... failed 100% of the tests

  • orphaned mode: Generating sources .............. success Compiling soures ................ success Running test with 8 threads ..... failed 100% of the tests
 #Tested Directive           t     ct     ot   oct
 omp_task_untied             0     -      0    -

 Summary:
 S Number of tested Open MP constructs: 1
 S Number of used tests:                2
 S Number of failed tests:              2
 S Number of successful tests:          0
 S + from this were verified:           0

 Normal tests:
 N Number of failed tests:              1
 N + from this fail compilation:        0
 N + from this timed out                0
 N Number of successful tests:          0
 N + from this were verified:           0

 Orphaned tests:
 O Number of failed tests:              1
 O + from this fail compilation:        0
 O + from this timed out                0
 O Number of successful tests:          0
 O + from this were verified:           0

 Testing for "omp_taskyield":
 Generating sources .............. success
 Compiling soures ................ success
 Running test with 8 threads ..... success ...Segmentation fault
 ... and verified with 139% certainty
 + orphaned mode:
 Generating sources .............. success
 Compiling soures ................ success
 Running test with 8 threads ..... failed 90% of the tests

 #Tested Directive           t     ct     ot  oct
 omp_taskyield               100   139    10  -

 Summary:
 S Number of tested Open MP constructs: 1
 S Number of used tests:                2
 S Number of failed tests:              1
 S Number of successful tests:          1
 S + from this were verified:           0

 Normal tests:
 N Number of failed tests:              0
 N + from this fail compilation:        0
 N + from this timed out                0
 N Number of successful tests:          1
 N + from this were verified:           0

 Orphaned tests:
 O Number of failed tests:              1
 O + from this fail compilation:        0
 O + from this timed out                0
 O Number of successful tests:          0
 O + from this were verified:           0

 Testing for "omp_task_final":
 Generating sources .............. success
 Compiling soures ................ success
 Running test with 8 threads ..... failed 100% of the tests
 + orphaned mode:
 Generating sources .............. success
 Compiling soures ................ success
 Running test with 8 threads ..... failed 100% of the tests

 #Tested Directive           t     ct     ot   oct
 omp_task_final              0     -      0    -

 Summary:
 S Number of tested Open MP constructs: 1
 S Number of used tests:                2
 S Number of failed tests:              2
 S Number of successful tests:          0
 S + from this were verified:           0

 Normal tests:
 N Number of failed tests:              1
 N + from this fail compilation:        0
 N + from this timed out                0
 N Number of successful tests:          0
 N + from this were verified:           0

 Orphaned tests:
 O Number of failed tests:              1
 O + from this fail compilation:        0
 O + from this timed out                0
 O Number of successful tests:          0
 O + from this were verified:           0

— Reply to this email directly or view it on GitHub https://github.com/clang-omp/clang/issues/41#issuecomment-52387097.