nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Payne <marka...@hotmail.com>
Subject RE: GitHTTP out of memory error
Date Fri, 04 Sep 2015 15:03:51 GMT
Mattie,

How large is the Java heap? This value is in the conf/bootstrap.conf file. You'll typically
see something like:

java.arg.3=-Xmx512m

Do you have any custom processors running in your flow, or are you using only Apache NiFi
provided processors?

Thanks
-Mark

________________________________
> From: Whitmore_Mattie@bah.com 
> To: users@nifi.apache.org 
> Subject: Re: GitHTTP out of memory error 
> Date: Fri, 4 Sep 2015 14:57:49 +0000 
> 
> Hi, 
> 
> I am 8 GetHTTP processors which run nightly, however 5 hours after 
> these run some threads out of memory: 
> 
> 
> ERROR [Timer-Driven Process Thread-23] 
> o.a.nifi.processors.standard.GetHTTP 
> GetHTTP[id=021562be-b123-4b3f-b5ed-2b8c47af6d4c] 
> GetHTTP[id=021562be-b123-4b3f-b5ed-2b8c47af6d4c] failed to process 
> session due to java.lang.OutOfMemoryError: Java heap space: 
> java.lang.OutOfMemoryError: Java heap space 
> 
> 2015-09-03 07:10:41,167 ERROR [Timer-Driven Process Thread-11] 
> o.a.nifi.processors.standard.GetHTTP 
> GetHTTP[id=0a5158d2-f082-4007-b646-3da8fb436fd0] 
> GetHTTP[id=0a5158d2-f082-4007-b646-3da8fb436fd0] failed to process 
> session due to java.lang.OutOfMemoryError: Java heap space: 
> java.lang.OutOfMemoryError: Java heap space 
> 
> 2015-09-03 07:10:41,168 WARN [Timer-Driven Process Thread-23] 
> o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding 
> GetHTTP[id=021562be-b123-4b3f-b5ed-2b8c47af6d4c] due to uncaught 
> Exception: java.lang.OutOfMemoryError: Java heap space 
> 
> 2015-09-03 07:10:41,168 WARN [Timer-Driven Process Thread-11] 
> o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding 
> GetHTTP[id=0a5158d2-f082-4007-b646-3da8fb436fd0] due to uncaught 
> Exception: java.lang.OutOfMemoryError: Java heap space 
> 
> I am running on Amazon Linux and have tuned the server as described in 
> the admin page. 
> 
> Thanks! 
> 
> Mattie Whitmore 
> Lead Technologist 
> 
> Booz | Allen | Hamilton 
> ________________________ 
> 
> 
 		 	   		  
Mime
View raw message