opensim-org / opensim-core

SimTK OpenSim C++ libraries and command-line applications, and Java/Python wrapping.
https://opensim.stanford.edu
Apache License 2.0
758 stars 308 forks source link

Add CI `windows2022` jobs for performance analysis #3754

Closed nickbianco closed 2 months ago

nickbianco commented 3 months ago

Brief summary of changes

Added updates to continuous_integration.yml to support running performance analysis jobs using either Mac or Windows runners. Since the self-hosted runner for Mac won't be ready for a while, I've set up a self-hosted runner for Windows on opensim-perf which these changes will let us access.

With these changes:

For now, only one of the two results will be posted below (whatever comes last). Posting both will come in a future PR when Mac perf analysis has a self-hosted runner.

Testing I've completed

The usual GitHub Actions seven stages of grief testing workflow.

Looking for feedback on...

CHANGELOG.md (choose one)

Performance analysis

Platform: Mac, GitHub Actions runner

Test Name lhs [secs] stderr [secs] rhs [secs] stderr [secs] Speedup
Arm26 0.61 0.48 0.60 0.48 1.01
ToyDropLanding 20.17 11.33 18.16 2.42 1.11
passive_dynamic_noanalysis 3.90 0.01 4.53 0.02 0.86
ToyDropLanding_function_based_paths 21.38 4.15 20.65 0.75 1.04
Gait2354 0.51 0.01 0.49 0.00 1.05
passive_dynamic 5.67 0.03 5.59 0.01 1.01
ToyDropLanding_nomuscles 0.71 0.00 0.70 0.00 1.01
MocoSlidingMass 1.91 0.00 1.92 0.02 0.99
RajagopalModel 12.04 1.07 11.72 0.04 1.03

This change is Reviewable

nickbianco commented 3 months ago

@carmichaelong this is ready for review now.