running java spark apps with spark-jobserver

[tomerben]

Hi,

I have a spark standalone cluster on ec2, and I would like to run java apps using the spark jobserver. I understand that I need to have my app main class extend the SparkJob trait, therefore implement in java the "runJob" and "validate" methods. I'm not sure how to do this though. Is there an example of a java app written for spark-jobserver I can learn from?

Thanks!

[velvia]

Hi there,

I hope to have better support for Java (maybe through an abstract class)
and an example soon.

thanks,
Evan

On Mon, Oct 20, 2014 at 7:57 AM, tomerben [email protected] wrote:

Hi,

I have a spark standalone cluster on ec2, and I would like to run java
apps using the spark jobserver. I understand that I need to have my app
main class extend the SparkJob trait, therefore implement in java the
"runJob" and "validate" methods. I'm not sure how to do this though. Is
there an example of a java app written for spark-jobserver I can learn from?

Thanks!

—
Reply to this email directly or view it on GitHub
#74.

The fruit of silence is prayer;
the fruit of prayer is faith;
the fruit of faith is love;
the fruit of love is service;
the fruit of service is peace. -- Mother Teresa

[sidahmedbenkhaoua]

http://stackoverflow.com/questions/27904861/spark-job-server-with-java