Add benchmarks to CI - Githubissues

mrpowers-io / spark-fast-tests

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

https://mrpowers-io.github.io/spark-fast-tests/

MIT License

429 stars 77 forks source link

Add benchmarks to CI #130

Open SemyonSinchenko opened 1 month ago

SemyonSinchenko commented 1 month ago

It would be very cool to have some performance benchmarks in CI. Benchmarks, mentioned in README is a nice thing to start from: https://github.com/mrpowers-io/spark-fast-tests?tab=readme-ov-file#why-is-this-library-fast

zeotuan commented 1 month ago

I did some test benchmarking on this https://github.com/mrpowers-io/spark-fast-tests/pull/122/files#diff-7e79c32936db58af66efbf87c7e0114672f89209aa69722e98abee90faee72e3. what do you think about using https://github.com/sbt/sbt-jmh

SemyonSinchenko commented 1 month ago

Looks cool, thank you! But we definitely should have it as a subproject.

zeotuan commented 1 week ago

@SemyonSinchenko I added a Draft with an initial project structure for Benchmarks module as well as an additional benchmark step for CI. Those we still need additional work for:

Test Data generation + Parameterized Benchmark
Investigate most appropriate, important test metric for the project