lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From entdeveloper <cameron.develo...@gmail.com>
Subject Re: Plugin Performance Issues
Date Wed, 28 Oct 2009 20:54:43 GMT

This is an issue we experienced a while back.  We once again tried to load a
custom class as a plugin jar from the lib directory and began experiencing
severe memory problems again.  The code in our jar wasn't being used at
all...the class was only referenced in the schema.  I find it strange that
no one else has experienced this, but we're not doing anything particularly
complex, which is still leading me to believe that there is something
strange going on with Solr's class loading for this lib directory.  Perhaps
it is something specific with our environment (specs below)?

java version "1.6.0_05"
Java(TM) SE Runtime Environment (build 1.6.0_05-b13)
Java HotSpot(TM) 64-Bit Server VM (build 10.0-b19, mixed mode)

Tomcat 6.0.16

Linux 2.6.9-35.ELsmp #1 SMP Thu Jun 1 14:31:29 PDT 2006 x86_64 x86_64 x86_64
GNU/Linux

Max heap set to 1GB.

With the jars in the plugin directory, RAM usage increases by 1.5 - 2GB,
increasing at about 200MB/hr.



hossman wrote:
> 
> 
> : I'm not entirely convinced that it's related to our code, but it could
> be. 
> : Just trying to get a sense if other plugins have had similar problems,
> just
> : by the nature of using Solr's resource loading from the /lib directory.
> 
> Plugins aren't something that every Solr users -- but enough people use 
> them that if there was a fundemental memory leak just from loading plugin 
> jars i'm guessing more people would be complaining.
> 
> I use plugins in several solr instances, and i've never noticed any 
> problems like you describe -- but i don't personally use tomcat.
> 
> Otis is right on the money: you need to use profiling tools to really look 
> at the heap and see what's taking up all that ram.
> 
> Alternately: a quick way to rule out the special plugin class loader would 
> be to embed your custom handler directly into the solr.war ("The Old Way" 
> on the SolrPlugins wiki) ... if you still have problems, then the cause 
> isn't the plugin classloader.
> 
> 
> 
> 
> 
> -Hoss
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/Plugin-Performance-Issues-tp24295010p26101741.html
Sent from the Solr - User mailing list archive at Nabble.com.


Mime
View raw message