Open countvajhula opened 2 years ago
Note for down the line: it would be great to add continuous benchmarking into the CI workflow, so that the performance effects of each commit are automatically tracked:
https://github.com/benchmark-action/github-action-benchmark
This will likely involve calling the existing benchmarking functions in profile/*
but generating the output in the JSON format described at the above link, i.e. {"name": <name-of-the-benchmark>, "unit": "ms", "value": <the-measured-value>}
.
These should be runnable via a Makefile target, e.g. make report-benchmarks
, which can be run in the GitHub Actions workflow just like the existing targets for testing, etc.
The current performance benchmarks in
profile/
that are run viamake profile
are inaccurate, and additionally, are not comprehensive.E.g. @michaelballantyne reports:
profile/forms.rkt
to include all Qi forms (currently these include only a few such asrelay
andgroup
).