lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Muir <rcm...@gmail.com>
Subject Re: [JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 786 - Still Failing
Date Wed, 01 Apr 2015 02:52:45 GMT
The problem is with NIGHTLY we generate many more documents, if we get
unlucky and get something like MemoryPostings also are indexing stuff
like payloads, we get huge FSTs (the outputs have big postings lists)

I don't want to lose coverage for Nightly/Direct so I removed the
NIGHTLY conditional logic in TestDuelingCodecs and spun off a separate
@Nightly subclass that just excludes the memory-hungry ones.

On Tue, Mar 31, 2015 at 10:15 PM, Robert Muir <rcmuir@gmail.com> wrote:
> I can reproduce it with current 5.x, it hits OOME after about 15 minutes.
>
> On Sat, Mar 14, 2015 at 11:01 AM, Apache Jenkins Server
> <jenkins@builds.apache.org> wrote:
>> Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/786/
>>
>> 1 tests failed.
>> REGRESSION:  org.apache.lucene.index.TestDuelingCodecs.testEquals
>>
>> Error Message:
>> Java heap space
>>
>> Stack Trace:
>> java.lang.OutOfMemoryError: Java heap space
>>         at __randomizedtesting.SeedInfo.seed([8353178BBB8D1BE0:873C441075B44BE2]:0)
>>         at org.apache.lucene.util.fst.BytesStore.skipBytes(BytesStore.java:307)
>>         at org.apache.lucene.util.fst.FST.addNode(FST.java:801)
>>         at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:126)
>>         at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:189)
>>         at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:277)
>>         at org.apache.lucene.util.fst.Builder.add(Builder.java:381)
>>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:257)
>>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$500(MemoryPostingsFormat.java:112)
>>         at org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:399)
>>         at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.write(PerFieldPostingsFormat.java:198)
>>         at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
>>         at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:186)
>>         at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:95)
>>         at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3933)
>>         at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3514)
>>         at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
>>         at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1803)
>>         at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4572)
>>         at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:704)
>>         at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4598)
>>         at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4589)
>>         at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1351)
>>         at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1138)
>>         at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:152)
>>         at org.apache.lucene.index.TestDuelingCodecs.createRandomIndex(TestDuelingCodecs.java:137)
>>         at org.apache.lucene.index.TestDuelingCodecs.testEquals(TestDuelingCodecs.java:149)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:606)
>>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
>>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 1706 lines...]
>>    [junit4] Suite: org.apache.lucene.index.TestDuelingCodecs
>>    [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant
get-jenkins-line-docs' in the lucene directory.
>>    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDuelingCodecs
-Dtests.method=testEquals -Dtests.seed=8353178BBB8D1BE0 -Dtests.multiplier=2 -Dtests.nightly=true
-Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=fr_BE
-Dtests.timezone=Africa/Timbuktu -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
>>    [junit4] ERROR   1667s J2 | TestDuelingCodecs.testEquals <<<
>>    [junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
>>    [junit4]    >        at __randomizedtesting.SeedInfo.seed([8353178BBB8D1BE0:873C441075B44BE2]:0)
>>    [junit4]    >        at org.apache.lucene.util.fst.BytesStore.skipBytes(BytesStore.java:307)
>>    [junit4]    >        at org.apache.lucene.util.fst.FST.addNode(FST.java:801)
>>    [junit4]    >        at org.apache.lucene.util.fst.NodeHash.add(NodeHash.java:126)
>>    [junit4]    >        at org.apache.lucene.util.fst.Builder.compileNode(Builder.java:189)
>>    [junit4]    >        at org.apache.lucene.util.fst.Builder.freezeTail(Builder.java:277)
>>    [junit4]    >        at org.apache.lucene.util.fst.Builder.add(Builder.java:381)
>>    [junit4]    >        at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.finishTerm(MemoryPostingsFormat.java:257)
>>    [junit4]    >        at org.apache.lucene.codecs.memory.MemoryPostingsFormat$TermsWriter.access$500(MemoryPostingsFormat.java:112)
>>    [junit4]    >        at org.apache.lucene.codecs.memory.MemoryPostingsFormat$MemoryFieldsConsumer.write(MemoryPostingsFormat.java:399)
>>    [junit4]    >        at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsWriter.write(PerFieldPostingsFormat.java:198)
>>    [junit4]    >        at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:105)
>>    [junit4]    >        at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:186)
>>    [junit4]    >        at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:95)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3933)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3514)
>>    [junit4]    >        at org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1803)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.doAfterSegmentFlushed(IndexWriter.java:4572)
>>    [junit4]    >        at org.apache.lucene.index.DocumentsWriter$MergePendingEvent.process(DocumentsWriter.java:704)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4598)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.processEvents(IndexWriter.java:4589)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1351)
>>    [junit4]    >        at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1138)
>>    [junit4]    >        at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:152)
>>    [junit4]    >        at org.apache.lucene.index.TestDuelingCodecs.createRandomIndex(TestDuelingCodecs.java:137)
>>    [junit4]    >        at org.apache.lucene.index.TestDuelingCodecs.testEquals(TestDuelingCodecs.java:149)
>>    [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/J2/temp/lucene.index.TestDuelingCodecs
8353178BBB8D1BE0-001
>>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{},
sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {body=DFR I(ne)BZ(0.3), titleTokenized=DFR
I(ne)LZ(0.3)}, locale=fr_BE, timezone=Africa/Timbuktu
>>    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65
(64-bit)/cpus=16,threads=1,free=151816600,total=475004928
>>    [junit4]   2> NOTE: All tests run in this JVM: [TestPrefixCodedTerms, TestCodecs,
TestSearcherManager, TestFrequencyTrackingRingBuffer, TestMixedCodecs, TestBlockPostingsFormat2,
TestSearchForDuplicates, TestDocIdSet, TestDoc, TestBinaryDocValuesUpdates, Test2BPositions,
TestConjunctionDISI, TestOmitPositions, TestPostingsEnum, TestCrash, TestPrefixFilter, TestQueryRescorer,
TestRateLimiter, TestMinimize, TestAtomicUpdate, TestSimilarity2, TestBytesRefArray, TestStringHelper,
TestCustomNorms, TestSortRandom, TestSearch, TestIndexWriterExceptions2, TestCloseableThreadLocal,
TestDeterminism, TestTermVectorsReader, Test2BPostings, TestStressNRT, TestCollectionUtil,
Test2BSortedDocValues, TestCompressingStoredFieldsFormat, TestTragicIndexWriterDeadlock, TestTermsEnum2,
TestPerFieldPostingsFormat, TestWorstCaseTestBehavior, TestRAMDirectory, TestDirectory, TestIndexWriterConfig,
Nested1, Nested2, Nested3, TestTerms, TestDuelingCodecs]
>>    [junit4] Completed on J2 in 1685.39s, 2 tests, 1 error <<< FAILURES!
>>
>> [...truncated 22 lines...]
>>    [junit4] JVM J2: stdout was not empty, see: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/core/test/temp/junit4-J2-20150314_133848_781.sysout
>>    [junit4] >>> JVM J2: stdout (verbatim) ----
>>    [junit4] java.lang.OutOfMemoryError: Java heap space
>>    [junit4] Dumping heap to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/heapdumps/java_pid84537.hprof
...
>>    [junit4] Heap dump file created [422813476 bytes in 0.708 secs]
>>    [junit4] <<< JVM J2: EOF ----
>>
>> [...truncated 11 lines...]
>> BUILD FAILED
>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:536:
The following error occurred while executing this line:
>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:477:
The following error occurred while executing this line:
>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61:
The following error occurred while executing this line:
>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39:
The following error occurred while executing this line:
>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build.xml:49:
The following error occurred while executing this line:
>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1370:
The following error occurred while executing this line:
>> /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:976:
There were test failures: 421 suites, 3375 tests, 1 error, 37 ignored (27 assumptions)
>>
>> Total time: 54 minutes 46 seconds
>> Build step 'Invoke Ant' marked build as failure
>> Archiving artifacts
>> Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716
>> Archived 6 artifacts
>> Archive block size is 32768
>> Received 0 blocks and 426409874 bytes
>> Compression is 0.0%
>> Took 1 min 23 sec
>> Recording test results
>> Email was triggered for: Failure
>> Sending email for trigger: Failure
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message