lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Renee Sun (JIRA)" <>
Subject [jira] Created: (SOLR-2138) Solr 1.4 takes long time to load cores (memory leak?)
Date Thu, 30 Sep 2010 20:50:34 GMT
Solr 1.4 takes long time to load cores (memory leak?)

                 Key: SOLR-2138
             Project: Solr
          Issue Type: Bug
    Affects Versions: 1.4
         Environment: 8 processors Intel(R) Xeon(R) CPU           E5345  @ 2.33GHz

            Reporter: Renee Sun

1. 32 GB total memory, with 16GB allocated to Solr server.
2. 130 cores, with most cores having 50,000 documents, and 2,3 cores having 1~2.4Million documents
(largest core takes about 11GB disk space)
3. in solr 1.3, there was no problem, it took 5,6 minutes to load up all cores.
4. just upgrade to solr 1.4, it takes about 45+ minutes to load all 130 cores.
5. no solrconfig or schema change
6. autowarmCount="0" for all caches

I have monitored the memory with JConsole. The 'queryConverter' warning in catalina.out file
helped me figured out that when about 70 cores were loaded, the memory usage went from 300MB
to 16GB, and stay at that level. Rest of the cores are loaded up extremely slow.

I find Yonik's fix note for SOLR-1797: fix ConcurrentModificationException and potential memory
  leaks in ResourceLoader. (yonik)

We are in process of upgrading to 1.4.1

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message