spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amit Sharma <resolve...@gmail.com>
Subject Re: Out of memory issue
Date Mon, 09 Nov 2020 21:04:57 GMT
Can you please help.


Thanks
Amit

On Sun, Nov 8, 2020 at 1:35 PM Amit Sharma <resolve123@gmail.com> wrote:

> Hi , I am using 16 nodes spark cluster with below config
> 1. Executor memory  8 GB
> 2. 5 cores per executor
> 3. Driver memory 12 GB.
>
>
> We have streaming job. We do not see problem but sometimes we get
> exception executor-1 heap memory issue. I am not understanding if data size
> is same and this job receive a request and process it but suddenly it’s
> start giving out of memory error . It will throw exception for 1 executor
> then throw for other executor also and it stop processing the request.
>
> Thanks
> Amit
>

Mime
View raw message