databricks / spark-perf

Performance tests for Apache Spark
Apache License 2.0
379 stars 203 forks source link

How can I run this Spark-Test with 2 or more Executors? #120

Open wtx626 opened 7 years ago

wtx626 commented 7 years ago

when I use this spark workbench , In yran-client , only one executor runing everytime . Although I edit the testsuits.py by adding --num-executors and the cmd is as /usr/hdp/2.5.0.0-1245/spark/bin/spark-submit --class spark.perf.TestRunner --master yarn --num-executors 2 --driver-memory 2g , but it still one executor working .