spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "" <>
Subject Re: Re: spark job paused(active stages finished)
Date Fri, 10 Nov 2017 05:37:53 GMT
    Thank you for your reply.
    But,sometimes successed, when i rerun the job.
    And the job process the same data using the same code.

From: Margusja
Date: 2017-11-09 14:25
CC: user
Subject: Re: spark job paused(active stages finished)
You have to deal with failed jobs. In example try catch in your code.

Br Margus Roo

On 9 Nov 2017, at 05:37, wrote:

    I have a simple spark job, as below, all tasks in the stage 2(sth failed, retry) already
finished. But the next stage never run.

        driver thread dump:  attachment( thread.dump)
        driver last log:
     driver do not receive the 16 retry tasks report.Thank you ideas.
To unsubscribe e-mail:

View raw message