search

earthobservations / gribmagic

Generic weather forecast downloader
https://community.panodata.org/t/developing-gribmagic/233
MIT License
21 stars 2 forks source link

CI: Parallelize test execution using `pytest-xdist` #18

Closed amotl closed 2 years ago

amotl commented 2 years ago

Running tests in parallel will make the overall process complete earlier, that's the idea. On my workstation, the execution time goes down from ~32s to ~18s, [1] vs. [2].

On CI (which needs to setup a full sandbox each time), the execution time goes down from ~5.5 minutes to ~2.75 minutes.

[1] time make test-coverage [2] time make test-coverage-parallel

codecov[bot] commented 2 years ago

Codecov Report

Merging #18 (7a603ce) into main (f7b0146) will decrease coverage by 1.10%. The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main      #18      +/-   ##
==========================================
- Coverage   90.85%   89.74%   -1.11%     
==========================================
  Files          24       24              
  Lines         995      995              
  Branches      108      108              
==========================================
- Hits          904      893      -11     
- Misses         66       75       +9     
- Partials       25       27       +2
Flag Coverage Δ
unittests 89.74% <100.00%> (-1.11%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
gribmagic/smith/regrid/cli.py 100.00% <ø> (ø)
gribmagic/unity/download/engine.py 79.66% <100.00%> (ø)
gribmagic/unity/reader.py 100.00% <100.00%> (ø)
gribmagic/smith/regrid/model.py 85.45% <0.00%> (-14.55%) :arrow_down:
gribmagic/util.py 90.32% <0.00%> (-9.68%) :arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update f7b0146...7a603ce. Read the comment docs.