lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yonik Seeley" <yo...@apache.org>
Subject Re: OOM on commit after few days
Date Tue, 02 Dec 2008 18:13:25 GMT
Using embedded is always more error prone...you're probably forgetting
to close some resource.
Make sure to close all SolrQueryRequest objects.
Start with a memory profiler or heap dump to try and figure out what's
taking up all the memory.

-Yonik

On Tue, Dec 2, 2008 at 1:05 PM, Sunil <sunilsarje@yahoo.com> wrote:
> I have been facing this issue since long in production environment and wanted to know
if anybody came across can share their thoughts.
> Appreciate your help.
>
> Environment
> 2 GB index file
> 3.5 million documents
> 15 mins. time interval for committing 100 to 400 document updates
>   Commit happens once in 15 mins.
> 3.5 GB of RAM available for JVM
> Solr Version 1.3 ; (nightly build of oct 18, 2008)
>
> MDB - Message Driven Bean
> I am Not using solr's replication mecahnism. Also don't use xml post update since the
amount of data is too much.
> I have bundled a MDB that receives messages for data updates and uses solr's update handler
to update and commit the index.
> Optimize happens once a day.
>
> Everything runs fine for 2-3 days; after that I keep getting following exceptions.
>
> Exception
> org.apache.solr.common.SolrException log java.lang.OutOfMemoryError:
>        at java.io.RandomAccessFile.readBytes(Native Method)
>        at java.io.RandomAccessFile.read(RandomAccessFile.java:350)
>        at org.apache.lucene.store.FSDirectory$FSIndexInput.readInternal(FSDirectory.java:596)
>        at org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java:136)
>        at org.apache.lucene.store.BufferedIndexInput.readBytes(BufferedIndexInput.java:92)
>        at org.apache.lucene.index.SegmentReader.norms(SegmentReader.java:907)
>        at org.apache.lucene.index.MultiSegmentReader.norms(MultiSegmentReader.java:338)
>        at org.apache.lucene.search.TermQuery$TermWeight.scorer(TermQuery.java:69)
>        at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:131)
>        at org.apache.lucene.search.Searcher.search(Searcher.java:126)
>        at org.apache.lucene.search.Searcher.search(Searcher.java:105)
>        at org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1170)
>        at org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:856)
>        at org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:283)
>        at org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:160)
>        at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:170)
>        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1302)
>        at org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:51)
>        at org.apache.solr.core.SolrCore$4.call(SolrCore.java:1128)
>        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:284)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:665)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:690)
>        at java.lang.Thread.run(Thread.java:810)
>
>

Mime
View raw message