search

moby / buildkit-bench

Set of benchmarks for BuildKit
https://moby.github.io/buildkit-bench/
Apache License 2.0
0 stars 2 forks source link

skip test on benchmark run #119

Closed crazy-max closed 1 month ago

crazy-max commented 1 month ago

currently all tests run along benchmarks ones: https://github.com/moby/buildkit-bench/actions/runs/10938507763/job/30366888476#step:8:32

=== RUN   TestBuildx/TestBuildxVersion/ref=v0.14.1/run=1
    buildx_test.go:20: github.com/docker/buildx v0.17.1 257815a6fbaee88976808020bf04274388275ae8

=== RUN   TestBuildx/TestBuildxVersion/ref=v0.15.0/run=1
    buildx_test.go:20: github.com/docker/buildx v0.17.1 257815a6fbaee88976808020bf04274388275ae8

=== RUN   TestBuildx/TestBuildxVersion/ref=v0.15.2/run=1
    buildx_test.go:20: github.com/docker/buildx v0.17.1 257815a6fbaee88976808020bf04274388275ae8

=== RUN   TestBuildx/TestBuildxVersion/ref=v0.16.0/run=1
    buildx_test.go:20: github.com/docker/buildx v0.17.1 257815a6fbaee88976808020bf04274388275ae8

=== RUN   TestBuildx/TestBuildxVersion/ref=v0.9.0/run=1
    buildx_test.go:20: github.com/docker/buildx v0.17.1 257815a6fbaee88976808020bf04274388275ae8

=== RUN   TestBuildx/TestBuildxVersion/ref=v0.9.3/run=1
    buildx_test.go:20: github.com/docker/buildx v0.17.1 257815a6fbaee88976808020bf04274388275ae8

--- PASS: TestBuildx (4.07s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-04/run=1 (0.59s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-05/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-06/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-09/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-10/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-11/run=1 (0.12s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-12/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-13/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=2024-09-16/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=master/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.10.0/run=1 (0.20s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.10.6/run=1 (0.20s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.11.0/run=1 (0.20s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.11.6/run=1 (0.20s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.12.0/run=1 (0.20s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.12.5/run=1 (0.20s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.13.0/run=1 (0.16s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.13.2/run=1 (0.16s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.14.0/run=1 (0.12s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.14.1/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.15.0/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.15.2/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.16.0/run=1 (0.11s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.9.0/run=1 (0.20s)
    --- PASS: TestBuildx/TestBuildxVersion/ref=v0.9.3/run=1 (0.20s)

We should them run independently from benchmarks.