databricks / spark-sql-perf

Apache License 2.0
586 stars 407 forks source link

Run mllib small in unit tests #141

Closed MrBago closed 6 years ago

MrBago commented 6 years ago

This is a follow up to #140 and should be merged after.

We don't currently have any unit tests for mllib benchmarks. We can run mllib-small.yaml in our unit tests to get decent test coverage our our benchmarks. With these parameters, the benchmarks run in ~ 60s.