search

ooyala / spark-jobserver

REST job server for Spark. Note that this is *not* the mainline open source version. For that, go to https://github.com/spark-jobserver/spark-jobserver. This fork now serves as a semi-private repo for Ooyala.
Other
344 stars 135 forks source link

running java spark apps with spark-jobserver #74

Open tomerben opened 9 years ago

tomerben commented 9 years ago

Hi,

I have a spark standalone cluster on ec2, and I would like to run java apps using the spark jobserver. I understand that I need to have my app main class extend the SparkJob trait, therefore implement in java the "runJob" and "validate" methods. I'm not sure how to do this though. Is there an example of a java app written for spark-jobserver I can learn from?

Thanks!

velvia commented 9 years ago

Hi there,

I hope to have better support for Java (maybe through an abstract class) and an example soon.

thanks, Evan

On Mon, Oct 20, 2014 at 7:57 AM, tomerben notifications@github.com wrote:

Hi,

I have a spark standalone cluster on ec2, and I would like to run java apps using the spark jobserver. I understand that I need to have my app main class extend the SparkJob trait, therefore implement in java the "runJob" and "validate" methods. I'm not sure how to do this though. Is there an example of a java app written for spark-jobserver I can learn from?

Thanks!

— Reply to this email directly or view it on GitHub https://github.com/ooyala/spark-jobserver/issues/74.

The fruit of silence is prayer; the fruit of prayer is faith; the fruit of faith is love; the fruit of love is service; the fruit of service is peace. -- Mother Teresa

sidahmedbenkhaoua commented 9 years ago

http://stackoverflow.com/questions/27904861/spark-job-server-with-java