spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peng Cheng <>
Subject What is the best way to handle transformations or actions that takes forever?
Date Mon, 16 Jun 2014 08:52:18 GMT
My transformations or actions has some external tool set dependencies and
sometimes they just stuck somewhere and there is no way I can fix them. If I
don't want the job to run forever, Do I need to implement several monitor
threads to throws an exception when they stuck. Or the framework can already
handle that?

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message