search

winway / commentRepo

commenyRepo
0 stars 0 forks source link

Spark-sql支持cluster模式 | winway's blog #16

Open winway opened 2 years ago

winway commented 2 years ago

https://winway.github.io/2022/01/16/sparksql-cluster/

问题 解决 问题使用Spark-sql执行sql不支持cluster模式，导致driver只能启动在提交机器，进而占用提交机大量内存。 Exception in thread “main” org.apache.spark.SparkException: Cluster deploy mode is not applicable to Spark SQL shell. 解决开发一个sp