suitable exector-memory for spark-sql-perf testing

databricks / spark-sql-perf

Apache License 2.0

586 stars 407 forks source link

suitable exector-memory for spark-sql-perf testing #183

Open william-wang opened 5 years ago

william-wang commented 5 years ago

Is it okay to configure "executor-memory=1G" ? I am running spark querying tpcds.tpcds2_4Queries(q1-q99) testing on 100G data on kubernetes cluster. I want to find out the most suitable executor-memory for these queries.