databricks / spark-sql-perf

Apache License 2.0
586 stars 407 forks source link

Benchmark for SparkR UDF *apply() APIs #163

Closed morewood closed 6 years ago

morewood commented 6 years ago

Add a benchmark for SparkR spark.lapply, dapply/dapplyCollect, gapply/gapplyCollect APIs. Test on synthesized data with different types and sizes.

falaki commented 6 years ago

Would you please give this a more descriptive title?

falaki commented 6 years ago

LGTM