search

EnricoMi / publish-unit-test-result-action

GitHub Action to publish unit test results on GitHub
Apache License 2.0
615 stars 184 forks source link

Assert JSON result of test files #567

Closed EnricoMi closed 8 months ago

EnricoMi commented 8 months ago

Adds JSON expectation files and asserts these as unit tests.

github-actions[bot] commented 8 months ago

Test Results (Test File)

97 tests  ±0   80 :white_check_mark: ±0   3m 25s :stopwatch: ±0s  1 suites ±0   17 :zzz: ±0   1 files   ±0    0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Test Files)

  214 files  +69     86 errors  731 suites  ±0   2h 12m 36s :stopwatch: ±0s 1 811 tests ± 0  1 518 :white_check_mark: ±0   73 :zzz: ±0  209 :x: ±0  11 :fire: ±0  4 109 runs  ± 0  3 424 :white_check_mark: ±0  214 :zzz: ±0  450 :x: ±0  21 :fire: ±0 

For more details on these parsing errors, failures and errors, see this check.

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Dockerfile)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Docker Image amd64)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Docker Image arm64)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (macOS python 3.8)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (macOS python venv)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (macOS python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (macOS 14 python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (macOS 11 python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Linux python venv)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Linux python 3.8)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (macOS 13 python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Linux python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Linux 20.04 python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Windows python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Windows 2019 python installed)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (Windows python venv)

   147 files  ±0     147 suites  ±0   43m 4s :stopwatch: + 1m 28s    436 tests ±0     436 :white_check_mark: ±0      0 :zzz: ±0  0 :x: ±0  64 092 runs  ±0  62 580 :white_check_mark: ±0  1 512 :zzz: ±0  0 :x: ±0 

Results for commit f460cc99. ± Comparison against base commit 8fdc3ca9.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 8 months ago

Test Results (reference)

    48 files      48 suites   14m 2s :stopwatch:    436 tests    434 :white_check_mark:   0 :zzz:  2 :x: 20 928 runs  20 377 :white_check_mark: 490 :zzz: 61 :x:

For more details on these failures, see this check.

Results for commit eb03e3fe.