Add spark.ml Tree perf tests

databricks / spark-perf

Performance tests for Apache Spark

Apache License 2.0

379 stars 203 forks source link

Closed feynmanliang closed 9 years ago

feynmanliang commented 9 years ago

Adds performance tests for Random Forests and GBDTS implemented in ML pipelines API.

Adds a coproduct type to support polymorphism in "decision-tree" tests
The perf-tests utilize the DataFrame API since the underlying models in ML are private. This makes performance dependent on Spark SQL

@mengxr @jkbradley

jkbradley commented 9 years ago

I'll take a look now

jkbradley commented 9 years ago

Just import reorg. I can merge it now, or after fixes, as you prefer. Thanks!

feynmanliang commented 9 years ago

Optimized imports

jkbradley commented 9 years ago

Now that the imports are optimal, I'll merge. : ) Thanks!