spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shifeng Xiao <xiaoshife...@gmail.com>
Subject restart spark streaming app
Date Fri, 12 Aug 2016 23:38:25 GMT
Hi folks,

I am using Spark streaming, and I am not clear if there is smart way to
restart the app once it fails, currently we just have one cron job to check
if the job is running every  2 or 5 minutes and restart the app when
necessary.

According to spark streaming guide:

   - *YARN* - Yarn supports a similar mechanism for automatically
   restarting an application. Please refer to YARN documentation for more
   details.


Not sure how to achieve that with YARN, anyone can help me on it?

Thanks

Mime
View raw message