search

bartosz25 / spark-scala-playground

Sample processing code using Spark 2.1+ and Scala
50 stars 25 forks source link

About adaptive execution #20

Open bithw1 opened 4 years ago

bithw1 commented 4 years ago

Hi, @bartosz25 In the coming Spark 3.0 release or in the master branch of Apache Spark git, The feature adaptive execution is mature, it will be released in Spark 3.0 Could you please write some articles on this topic if you got spare time? The code is under the package org.apache.spark.sql.execution.adaptive of sql/core module.

Thanks you, @bartosz25 , for the great help !

bartosz25 commented 4 years ago

Hi @bithw1

Yes, I already have this feature on my list to things to cover for the "What's new in Spark" series :)

Cheers, Bartosz.

bithw1 commented 4 years ago

Thanks @bartosz25 , that's great, waiting for your great articles, :-)