lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jaeger, Jay - DOT" <Jay.Jae...@dot.wi.gov>
Subject RE: Performance troubles with solr
Date Wed, 14 Sep 2011 14:38:18 GMT
I think folks are going to need a *lot* more information.  Particularly

1.  Just what does your "test script" do?   Is it doing updates, or just queries of the sort
you mentioned below?  
2.  If the test script is doing updates, how are those updates being fed to Solr?  
3.  What version of Solr are you running?
4.  Why did you increase the default for jetty (around 384m) to 6000m, particularly given
your relatively modest number of documents (2,000,000).
5.  Machine characteristics, particularly operating system and physical memory on the machine.

Please refer to http://wiki.apache.org/solr/UsingMailingLists for additional guidance in using
the mailing list to get help.

-----Original Message-----
From: Yusuf Karakaya [mailto:karakayaysf@gmail.com] 
Sent: Wednesday, September 14, 2011 9:19 AM
To: solr-user@lucene.apache.org
Subject: Performance troubles with solr

Hi, i'm having performance troubles with solr. I don't know if i'm expection
too much from solr or i missconfigured solr.
When i run a single query its QTime is 500-1000~ ms (without any use of
caches).
When i run my test script (with use of caches) QTime increases
exponentially, reaching 8000~ to 60000~  ms. And Cpu usage also increases to
%550~

My solr-start script:
java -Duser.timezone=EET -Xmx6000m -jar ./start.jar

2,000,000~ documents ,  currently there aren't any commits but in future
there will be 5,000~ updates/additions to documents every 3-5~   min via
delta import.

Search Query
sort=userscore+desc
&start=0
&q=photo_id:* AND gender:true AND country:MALAWI AND online:false
&fq=birth:[NOW-31YEARS/DAY TO NOW-17YEARS/DAY]  ( Random age ranges )
&fq=lastlogin:[* TO NOW-6MONTHS/DAY] ( Only 2 options,   [* TO
NOW-6MONTHS/DAY] or [NOW-6MONTHS/DAY TO *] )
&fq=userscore:[500 TO *]  ( Only 2 options, [500 TO *] or [* TO 500] )
&rows=150

Schema

<field name="id" type="long" indexed="true" stored="true" required="true"/>
<field name="username" type="string" indexed="true" stored="false"
required="true"/>
<field name="namesurname" type="string" indexed="true" stored="false"/>
<field name="network" type="int" indexed="true" stored="false"/>
<field name="photo_id" type="int" indexed="true" stored="false"/>
<field name="gender" type="boolean" indexed="true" stored="false"/>
<field name="country" type="string" indexed="true" stored="false"/>
<field name="birth" type="tdate" indexed="true" stored="false"/>
<field name="lastlogin" type="tdate" indexed="true" stored="false"/>
<field name="online" type="boolean" indexed="true" stored="false"/>
<field name="userscore" type="int" indexed="true" stored="false"/>

Cache Sizes & Lazy Load

<filterCache class="solr.FastLRUCache" size="16384" initialSize="4096"
autowarmCount="4096"/>
<queryResultCache class="solr.LRUCache" size="16384" initialSize="4096"
autowarmCount="4096"/>
<documentCache class="solr.LRUCache" size="16384" initialSize="4096"
autowarmCount="4096"/>
<enableLazyFieldLoading>true</enableLazyFieldLoading>

Mime
View raw message