The follwing are the parameters:

发件人: Ted Yu <>
发送时间: 2016年5月30日 9:47:05
收件人: condor join
主题: Re: G1 GC takes too much time
bq. It happens during the Reduce majority.

Did the above refer to reduce operation ?

Can you share your G1GC parameters (and heap size for workers) ?


On Sun, May 29, 2016 at 6:15 PM, condor join <> wrote:
my spark application failed due to take too much time during GC. Looking at the logs I found these things:
1.there are Young GC takes too much time,and not found Full GC happen this;
2.The time takes too much during the object copy;
3.It happened  more easily when there were not enough resources;
4.It happens during the Reduce majority.

have anyone met the same question?

To unsubscribe, e-mail:
For additional commands, e-mail: