spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Femi Anthony <>
Subject Re: Job never finishing
Date Wed, 21 Feb 2018 00:22:55 GMT
You can use spark speculation as a way to get around the problem.

Here is a useful link:

Sent from my iPhone

> On Feb 20, 2018, at 5:52 PM, Nikhil Goyal <> wrote:
> Hi guys,
> I have a job which gets stuck if a couple of tasks get killed due to OOM exception. Spark
doesn't kill the job and it keeps on running for hours. Ideally I would expect Spark to kill
the job or restart the killed executors but nothing seems to be happening. Anybody got idea
about this?
> Thanks
> Nikhil

View raw message