spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Margusja <mar...@roo.ee>
Subject Re: spark job paused(active stages finished)
Date Thu, 09 Nov 2017 06:25:56 GMT
You have to deal with failed jobs. In example try catch in your code.

Br Margus Roo


> On 9 Nov 2017, at 05:37, bingli3@iflytek.com wrote:
> 
> Dear,All
>     I have a simple spark job, as below, all tasks in the stage 2(sth failed, retry)
already finished. But the next stage never run.
> 
> <Catch.jpg>
>    
>         driver thread dump:  attachment( thread.dump)
>         driver last log:
>             <CatchAFFD.jpg>
>             
>      driver do not receive the 16 retry tasks report.Thank you ideas.
>             
> <thread.dump>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org <mailto:user-unsubscribe@spark.apache.org>

Mime
View raw message