lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Otis Gospodnetic <otis_gospodne...@yahoo.com>
Subject Re: Help optimizing
Date Sun, 04 May 2008 02:32:21 GMT
Daniel,

1.5 seconds is quite long and 60 seconds is....more than scary - smells like some is not set
up right.
You have a lot of fields of type text, but a number of field sound like they really need not
be tokenized and should thus be of type string.
Do you really need 6 warming searchers?
I think "date" type is pretty granular.  Do you really need that type of precision?
I don't have shell handy here to check, but is that 'M' in -Xmx... recognized, or should it
be lowercase 'm'?
Have you noticed anything weird while looking at the Solr Java process with jConsole?

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch

----- Original Message ----
> From: Daniel Andersson <daniel@polkabrothers.com>
> To: solr-user@lucene.apache.org
> Sent: Saturday, May 3, 2008 7:06:10 PM
> Subject: Help optimizing
> 
> Hi (again) people
> 
> We've now invested in a server with 8 GB of RAM after too many  
> OutOfMemory-errors.
> 
> Our database/index is 3.5 GB and contains 4,352,471 documents. Most  
> documents are less than 1 kb. When performing a search, the results  
> vary between 1.5 seconds up to 60 seconds.
> 
> I don't have a big problem with 1.5 seconds (even though below 1 would  
> be nice), but 60 seconds it just.. well, scary.
> 
> How do I optimize Solr to better use all the RAM? I'm using java6,  
> 64bit version, and start Solr using:
> java -Xmx7500M -Xms4096M -jar start.jar
> 
> But according to top it only seems to be using 7.7% of the memory  
> (around 600 MB).
> 
> Most queries are for make_id + model_id or city + state and almost all  
> of the queries are ordered by datetime_found (newest -> oldest).
> 
> from schema.xml:
>     
> required="true" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValues="true" />
>     
> multiValued="false" />
>     
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
>     
> multiValued="false" />
>     
> multiValued="false" />
>     
>     
>     
> stored="true" multiValued="false" />
> 
>     
>     
> multiValued="true"/>
> 
>     
>     
>     
> 
> 
> from solrconfig.xml:
>      
>        class="solr.LRUCache"
>        size="4096"
>        initialSize="4096"
>        autowarmCount="2048"/>
> 
>      
>        class="solr.LRUCache"
>        size="4096"
>        initialSize="4096"
>        autowarmCount="2048"/>
> 
>      
>        class="solr.LRUCache"
>        size="4096"
>        initialSize="4096"
>        autowarmCount="0"/>
> 
>      50
> 
>      1000
> 
>      
>      
>        
>           datetime_found 0> str> 10 
>        
>      
> 
>      
>        
>           datetime_found 0> str> 10 
>        
>      
> 
>      true
>      6
> 
> Any help much appreciated!
> 
> Kind regards,
> Daniel
> 



Mime
View raw message