Explore how to limit number of cores used in standalone mode

qbicsoftware / spark-service

MIT License

0 stars 1 forks source link

Closed Zethson closed 5 years ago

Zethson commented 5 years ago

--executor-cores 1 --total-executor-cores 2

may also not work.

Zethson commented 5 years ago

They do work. Also, limiting the number of worker cores/number of workers clearly influences the cores used.