nod-ai / SHARK-TestSuite

Temporary home of a test suite we are evaluating
Apache License 2.0
5 stars 35 forks source link

Parallelize remote file downloads within each iree_tests directory. #297

Closed ScottTodd closed 4 months ago

ScottTodd commented 4 months ago

Progress on https://github.com/nod-ai/SHARK-TestSuite/issues/285

This is a simple improvement over serial processing, but it could still be improved further.

Looks like this shaves ~10 seconds off runs in this repo:

I saw 2m+ runs in IREE, hopefully this helps there too. Should be able to get the total time down to 10-20 seconds.

saienduri commented 4 months ago

Nice, hopefully this parallelization doesn't crash anything lol