lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bastian Spitzer" <bspit...@magix.net>
Subject Re: SolrException log
Date Mon, 23 Aug 2010 14:39:57 GMT
Hi Tommaso,

Thanks for your Reply. The Solr Files are on local disk, on a reiserfs. I'll try to set a
Deletion Policy and report back if
that solved the problem, thank you for the hint.

cheers,
Bastian

-----Urspr√ľngliche Nachricht-----
Von: Tommaso Teofili [mailto:tommaso.teofili@gmail.com] 
Gesendet: Montag, 23. August 2010 15:31
An: solr-user@lucene.apache.org
Betreff: Re: SolrException log

Hi Bastian,
this seems to be related to IO and file deletion (optimization compacts and removes index
files), are you running Solr on NFS or a distributed file system?
You could set a propert IndexDeletionPolicy (SolrDeletionPolicy) in solrconfig.xml to handle
this.
My 2 cents,
Tommaso

2010/8/11 Bastian Spitzer <bspitzer@magix.net>

> Hi,
>
> we are using solr 1.4.1 in a master-slave setup with replication, 
> requests are loadbalanced to both instances. this is just working 
> fine, but the slave behaves strange sometimes with a "SolrException 
> log" (trace below). We are using 1.4.1 for weeks now, and this has 
> happened only a few times so far, and it only occured on the Slave. 
> The Problem seemed to be gone when we added a cron-job to send a 
> periodic <optimize/> (once a day) to the master, but today it did 
> happen again. The Index contains 55 files right now, after optimize 
> there are only 10. So it seems its a problem when the index is spread 
> among a lot files. The Slave wont ever recover once this Exception 
> shows up, the only thing that helps is a restart.
>
> Is this a known issue? Only workaround would be to track the 
> commit-counts and send additional <optimize/> requests after a certain 
> amount of commits, but id prefer solving this problem rather than 
> building a workaround..
>
> Any hints/thoughts on this issue are verry much appreciated, thanks in 
> advance for your help.
>
> cheers Bastian.
>
> Aug 11, 2010 4:51:58 PM org.apache.solr.core.SolrCore execute
> INFO: [] webapp=/solr path=/select
> params={fl=media_id,keyword_1004&sort=priority_1000+desc,+score+desc&i
> nd 
> ent=off&start=0&q=mandant_id:1000+AND+partner_id:1000+AND+active_1000:
> tr
> ue+AND+cat_id_path_1000:7231/7258*+AND+language_id:1004&rows=24&versio
> ue+AND+n=
> 2.2} status=500 QTime=2
> Aug 11, 2010 4:51:58 PM org.apache.solr.common.SolrException log
> SEVERE: java.io.IOException: read past EOF
>        at
> org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.j
> av
> a:151)
>        at
> org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput
> .j
> ava:38)
>        at
> org.apache.lucene.store.IndexInput.readVInt(IndexInput.java:78)
>        at
> org.apache.lucene.index.SegmentTermDocs.next(SegmentTermDocs.java:112)
>        at
> org.apache.lucene.search.FieldCacheImpl$IntCache.createValue(FieldCach
> eI
> mpl.java:461)
>        at
> org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:
> 22
> 4)
>        at
> org.apache.lucene.search.FieldCacheImpl.getInts(FieldCacheImpl.java:430)
>        at
> org.apache.lucene.search.FieldCacheImpl$IntCache.createValue(FieldCach
> eI
> mpl.java:445)
>        at
> org.apache.lucene.search.FieldCacheImpl$Cache.get(FieldCacheImpl.java:
> 22
> 4)
>        at
> org.apache.lucene.search.FieldCacheImpl.getInts(FieldCacheImpl.java:430)
>        at
> org.apache.lucene.search.FieldComparator$IntComparator.setNextReader(F
> ie
> ldComparator.java:332)
>        at
> org.apache.lucene.search.TopFieldCollector$MultiComparatorNonScoringCo
> ll
> ector.setNextReader(TopFieldCollector.java:435)
>        at
> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:249)
>        at org.apache.lucene.search.Searcher.search(Searcher.java:171)
>        at
> org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.
> java:988)
>        at
> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher
> .j
> ava:884)
>        at
> org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java
> :3
> 41)
>        at
> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.
> java:182)
>        at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(Sear
> ch
> Handler.java:195)
>        at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandle
> rB
> ase.java:131)
>        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
>        at
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.
> ja
> va:338)
>        at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter
> .j
> ava:241)
>        at
> org.mortbay.jetty.servlet.WebApplicationHandler$CachedChain.doFilter(W
> eb
> ApplicationHandler.java:821)
>        at
> org.mortbay.jetty.servlet.WebApplicationHandler.dispatch(WebApplicatio
> nH
> andler.java:471)
>        at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:568)
>        at org.mortbay.http.HttpContext.handle(HttpContext.java:1530)
>        at
> org.mortbay.jetty.servlet.WebApplicationContext.handle(WebApplicationC
> on
> text.java:633)
>        at org.mortbay.http.HttpContext.handle(HttpContext.java:1482)
>        at org.mortbay.http.HttpServer.service(HttpServer.java:909)
>        at
> org.mortbay.http.HttpConnection.service(HttpConnection.java:820)
>        at
> org.mortbay.http.ajp.AJP13Connection.handleNext(AJP13Connection.java:2
> 95
> )
>        at
> org.mortbay.http.HttpConnection.handle(HttpConnection.java:837)
>        at
> org.mortbay.http.ajp.AJP13Listener.handleConnection(AJP13Listener.java
> :2
> 12)
>        at
> org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:357)
>        at
> org.mortbay.util.ThreadPool$PoolThread.run(ThreadPool.java:534)
>

Mime
View raw message