pyt-team / TopoModelX

Topological Deep Learning
MIT License
219 stars 79 forks source link

Improving speed of Pytest Suite #248

Closed devendragovil closed 10 months ago

devendragovil commented 10 months ago

This PR improves the run times of the CI/CD pipeline bringing run times down from ~ 22 minutes to around 5.5 minutes.

These are the approaches used:

  1. Parallelization of the tests taking advantage of the 2 CPUs that Github Action runners have
  2. Splitting pytests based on previous run times, to have even partition of tests
  3. Reducing number of epochs in tutorials
  4. Refactoring of the code and CI/CD pipeline

This largely addresses #215

There are some techniques that can be used later for further speedups.

review-notebook-app[bot] commented 10 months ago

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

codecov[bot] commented 10 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (e5e835e) 96.54% compared to head (10755f2) 96.54%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #248 +/- ## ======================================= Coverage 96.54% 96.54% ======================================= Files 58 58 Lines 2229 2229 ======================================= Hits 2152 2152 Misses 77 77 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.