spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sathish Kumaran Vairavelu <vsathishkuma...@gmail.com>
Subject Re: Spark Job trigger in production
Date Wed, 20 Jul 2016 13:47:52 GMT
If you are using Mesos, then u can use Chronos or Marathon
On Wed, Jul 20, 2016 at 6:08 AM Rabin Banerjee <dev.rabin.banerjee@gmail.com>
wrote:

> ++ crontab :)
>
> On Wed, Jul 20, 2016 at 9:07 AM, Andrew Ehrlich <andrew@aehrlich.com>
> wrote:
>
>> Another option is Oozie with the spark action:
>> https://oozie.apache.org/docs/4.2.0/DG_SparkActionExtension.html
>>
>> On Jul 18, 2016, at 12:15 AM, Jagat Singh <jagatsingh@gmail.com> wrote:
>>
>> You can use following options
>>
>> * spark-submit from shell
>> * some kind of job server. See spark-jobserver for details
>> * some notebook environment See Zeppelin for example
>>
>>
>>
>>
>>
>> On 18 July 2016 at 17:13, manish jaiswal <manishsrm14@gmail.com> wrote:
>>
>>> Hi,
>>>
>>>
>>> What is the best approach to trigger spark job in production cluster?
>>>
>>
>>
>>
>

Mime
View raw message