lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael McCandless (JIRA)" <>
Subject [jira] Commented: (LUCENE-1409) read past EOF
Date Wed, 01 Oct 2008 22:18:44 GMT


Michael McCandless commented on LUCENE-1409:

Apparently, compass committed its transaction and is attempting to reopen the IndexReader
but the reopen hits that exception because somehow the fieldInfos file (*.fnm) for one of
your segments is 0 bytes long.

I don't know what would do truncate your _X.fnm file like that.

Which OS are you on?

Are you sure there's nothing external to Lucene that might interfere w/ the index files? 
Or, is it possible you have filesystem corrutption (does this happen on a different computer)?
 Or could it be that two writers are accidentally operating on this index at once?

bq. That slowdown I think is caused by optimizer as you wrote

I turned off optimize as you suggested.  It helped, but, strangely, it's still drastically
slowing down.  Have other users of compass seen this?

> read past EOF
> -------------
>                 Key: LUCENE-1409
>                 URL:
>             Project: Lucene - Java
>          Issue Type: Bug
>    Affects Versions: 2.3.2
>         Environment: jdk 1.5.0_08
>            Reporter: Adam Łączyński
> I create index with a lot of documents (~500 000). During add documents to "read past
EOF" error occured. It occure after random number of indexed documents. I used lucene with
compass framework but I think that is not important. It is a link to compass forum where that
problem was reporeted
> read past EOF
> 	at
> 	at
> 	at
> 	at
> 	at org.apache.lucene.index.FieldInfos.<init>(
> 	at org.apache.lucene.index.SegmentReader.initialize(
> 	at org.apache.lucene.index.SegmentReader.get(
> 	at org.apache.lucene.index.SegmentReader.get(
> 	at org.apache.lucene.index.MultiSegmentReader.<init>(
> 	at org.apache.lucene.index.MultiSegmentReader.doReopen(
> 	at org.apache.lucene.index.DirectoryIndexReader$2.doBody(
> 	at org.apache.lucene.index.SegmentInfos$
> 	at org.apache.lucene.index.DirectoryIndexReader.reopen(
> 	at org.compass.core.lucene.engine.manager.DefaultLuceneSearchEngineIndexManager.internalRefreshCache(
> 	at org.compass.core.lucene.engine.manager.DefaultLuceneSearchEngineIndexManager.refreshCache(
> 	at org.compass.core.lucene.engine.transaction.readcommitted.ReadCommittedTransaction$
> 	at org.compass.core.transaction.context.TransactionalCallable$1.doInTransaction(
> 	at org.compass.core.impl.DefaultCompass$CompassTransactionContext.execute(
> 	at
> 	at org.compass.core.executor.DefaultExecutorManager.invokeAllWithLimit(
> 	at org.compass.core.executor.DefaultExecutorManager.invokeAllWithLimitBailOnException(
> 	at org.compass.core.lucene.engine.transaction.readcommitted.ReadCommittedTransaction.doCommit(
> 	at org.compass.core.lucene.engine.transaction.AbstractTransaction.commit(
> 	at org.compass.core.lucene.engine.LuceneSearchEngine.commit(
> 	at org.compass.core.transaction.LocalTransaction.doCommit(
> 	at org.compass.core.transaction.AbstractTransaction.commit(
> 	at org.compass.core.CompassTemplate.execute(
> 	at org.compass.core.CompassTemplate.execute(
> 	at asl.simplesearch.compass.CompassService.createCall(Unknown Source)
> 	at asl.util.IndexCreator.createIndex(Unknown Source)
> 	at asl.util.IndexCreator.start(Unknown Source)
> 	at asl.util.IndexCreatorTestCase.main(

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message