Start and shut down spark session programmatically

TresAmigosSD / SMV

Spark Modularized View

Apache License 2.0

42 stars 22 forks source link

Start and shut down spark session programmatically #1596

Open ninjapapa opened 5 years ago

ninjapapa commented 5 years ago

We start spark session before init an SmvApp. Although we allow creating SmvApp without spark, we are not able to change it.

Ideally, we should start an SmvApp without spark, then create a spark session. API calls should be created shut down the spark session, and restart within the same SmvApp instance.

AliTajeldin commented 5 years ago

@ninjapapa : After our discussion yesterday, I don't think this will be needed.