halide / Halide

a language for fast, portable data-parallel computation
https://halide-lang.org
Other
5.91k stars 1.07k forks source link

Get more consistent distributions in parallel scenarios test #8451

Closed abadams closed 15 hours ago

abadams commented 3 weeks ago

Note that this is not denoising the individual runtimes. The point of the test is to measure a distribution of runtimes for a variety of scenarios. This PR takes more samples for each distribution, and spreads the samples out over time to dodge transitory OS stuff by interleaving different test scenarios.

I also tweaked some of the scenarios to be more useful, and reported actual deciles so that the median is actually there.

steven-johnson commented 3 days ago

ready to land?

abadams commented 3 days ago

Looks like there was a merge conflict to fix. Apart from that, assuming everything goes green, yes

abadams commented 15 hours ago

Failures are all vulkan stuff