spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: GC overhead limit exceeded
Date Thu, 27 Mar 2014 15:24:18 GMT
This is another way of Java saying "you ran out of heap space". As
less and less room is available, the GC kicks in more often, freeing
less each time. Before the very last byte of memory is gone, Java may
declare defeat. That's why it's taking so long, and you simply need a
larger heap in whatever is throwing this error.
--
Sean Owen | Director, Data Science | London


On Thu, Mar 27, 2014 at 4:21 PM, Sai Prasanna <ansaiprasanna@gmail.com> wrote:
> "java.lang.OutOfMemoryError: GC overhead limit exceeded"
>
> What is the problem. The same code, i run, one instance it runs in 8 second,
> next time it takes really long time, say 300-500 seconds...
> I see the logs a lot of GC overhead limit exceeded is seen. What should be
> done ??
>
> Please can someone throw some light on it ??
>
>
>
> --
> Sai Prasanna. AN
> II M.Tech (CS), SSSIHL
>
> Entire water in the ocean can never sink a ship, Unless it gets inside.
> All the pressures of life can never hurt you, Unless you let them in.

Mime
View raw message