spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peng Cheng <pc...@uow.edu.au>
Subject What is the best way to handle transformations or actions that takes forever?
Date Mon, 16 Jun 2014 08:52:18 GMT
My transformations or actions has some external tool set dependencies and
sometimes they just stuck somewhere and there is no way I can fix them. If I
don't want the job to run forever, Do I need to implement several monitor
threads to throws an exception when they stuck. Or the framework can already
handle that?



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-is-the-best-way-to-handle-transformations-or-actions-that-takes-forever-tp7664.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message