how to send jobs to spark cluster

streamsets / tutorials

StreamSets Tutorials

Apache License 2.0

348 stars 192 forks source link

how to send jobs to spark cluster #61

Closed kai-up closed 7 years ago

kai-up commented 7 years ago

spark evaluator runs in local, is there any way to send jobs to a spark cluster to execute ? I have a spark cluster managed in standalone mode, how to send jobs to it ? I call setMaster() method to point spark's master to my spark cluster in init method of my spark transformer, but it seems not work .

dimaspivak commented 7 years ago

Hi @kaige11, please go through the Community for questions about using SDC.