search

RMI-PACTA / actions

Actions for GitHub workflows
4 stars 0 forks source link

Add some sort of benchmarking #21

Open jdhoffa opened 9 months ago

jdhoffa commented 9 months ago

TBD what this exactly looks like (and likely depends on some demo data to be able to not only build but also test run our Docker builds), but it would be cool to know if a PR significantly affects the existing performance

AlexAxthelm commented 9 months ago

Are you thinking of something like timing the tests?

test main PR diff
test-foo.R 3.25 4.23 🔴 +30.1%
test-bar.R 1.18 1.18 ⚪ 0%
test-baz.R 8.97 7.2 🟢 -19.7%
OVERALL 13.4 12.61 🟢 -5.8%

Seems implementable for the testthat tests, but could be extended for other test suites (if we write them)

jdhoffa commented 9 months ago

That could be a good and somewhat low-hanging fruit approach!