Cleanups from spark 1.5 mllib perf tests

databricks / spark-perf

Performance tests for Apache Spark

Apache License 2.0

379 stars 203 forks source link

Cleanups from spark 1.5 mllib perf tests #88

Closed jkbradley closed 9 years ago

jkbradley commented 9 years ago

More tests should be runnable for GLMs. Some config fixes.

CC @mengxr

jkbradley commented 9 years ago

Ran tests locally. All run (except some missing Python ones)

mengxr commented 9 years ago

LGTM if we are going to deprecate 1.1/1.2/1.3/1.4. Otherwise, code changes that affect runtime should be applied to all branches or it will be very hard to debug when we see performance regression.

jkbradley commented 9 years ago

Yeah, I was assuming we didn't care about 1.4-, but I can update those if you'd like.

mengxr commented 9 years ago

Not necessary. We only compare 1.5 and 1.6 this time.

jkbradley commented 9 years ago

Oops, updated already. It's just a set of one-liners.

jkbradley commented 9 years ago

Rebased after merging the other PR which removed 1.3- support

mengxr commented 9 years ago

Merged into master. Thanks!