lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robert Muir <rcm...@gmail.com>
Subject Re: TestIndexWriterDelete fails with OOM
Date Thu, 02 Aug 2012 17:35:04 GMT
this test method uses only one field, but disables simpletext and
memory already. i think directPF was just an omission. I'll add it
too.

On Thu, Aug 2, 2012 at 11:07 AM, Simon Willnauer
<simon.willnauer@gmail.com> wrote:
> I see this on http://85.25.120.39/job/Lucene-trunk-Linux-Java6-64/162/console
> should we disable the mem intensive codecs for this test?
>
> [junit4:junit4] Suite: org.apache.lucene.index.TestIndexWriterDelete
> [junit4:junit4] ERROR   35.5s J1 |
> TestIndexWriterDelete.testIndexingThenDeleting
> [junit4:junit4]    > Throwable #1: java.lang.OutOfMemoryError: Java heap space
> [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([F645C683FAA013CE:8FD749EA602CCB95]:0)
> [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectField.<init>(DirectPostingsFormat.java:385)
> [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.DirectPostingsFormat$DirectFields.<init>(DirectPostingsFormat.java:130)
> [junit4:junit4]    >    at
> org.apache.lucene.codecs.memory.DirectPostingsFormat.fieldsProducer(DirectPostingsFormat.java:112)
> [junit4:junit4]    >    at
> org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:186)
> [junit4:junit4]    >    at
> org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:250)
> [junit4:junit4]    >    at
> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:107)
> [junit4:junit4]    >    at
> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:55)
> [junit4:junit4]    >    at
> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
> [junit4:junit4]    >    at
> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:638)
> [junit4:junit4]    >    at
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
> [junit4:junit4]    >    at
> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:62)
> [junit4:junit4]    >    at
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:583)
> [junit4:junit4]    >    at
> org.apache.lucene.index.TestIndexWriterDelete.testIndexingThenDeleting(TestIndexWriterDelete.java:935)
> [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit4:junit4]    >    at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> [junit4:junit4]    >    at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> [junit4:junit4]    >    at java.lang.reflect.Method.invoke(Method.java:597)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1995)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:818)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:877)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:891)
> [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32)
> [junit4:junit4]    >    at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68)
> [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> [junit4:junit4]    >    at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:825)
> [junit4:junit4]    >    at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132)
> [junit4:junit4]    >
> [junit4:junit4]   2> NOTE: download the large Jenkins line-docs file
> by running 'ant get-jenkins-line-docs' in the lucene directory.
> [junit4:junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=TestIndexWriterDelete
> -Dtests.method=testIndexingThenDeleting -Dtests.seed=F645C683FAA013CE
> -Dtests.multiplier=3 -Dtests.nightly=true -Dtests.slow=true
> -Dtests.linedocsfile=/var/lib/jenkins/lucene-data/enwiki.random.lines.txt
> -Dtests.locale=vi -Dtests.timezone=America/St_Barthelemy
> -Dtests.file.encoding=UTF-8
> [junit4:junit4]   2>
> [junit4:junit4]    > (@AfterClass output)
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40:
> {content=PostingsFormat(name=Asserting),
> id=MockVariableIntBlock(baseBlockSize=5),
> field=PostingsFormat(name=Direct), body=PostingsFormat(name=Direct),
> contents=PostingsFormat(name=Memory doPackFST= false),
> value=PostingsFormat(name=Asserting),
> city=MockVariableIntBlock(baseBlockSize=5)},
> sim=RandomSimilarityProvider(queryNorm=true,coord=false): {content=IB
> LL-D3(800.0), field=DFR GL3(800.0), body=DFR I(F)B3(800.0),
> contents=LM Jelinek-Mercer(0.700000), city=DFR I(n)2}, locale=vi,
> timezone=America/St_Barthelemy
> [junit4:junit4]   2> NOTE: Linux 3.2.0-26-generic amd64/Sun
> Microsystems Inc. 1.6.0_33
> (64-bit)/cpus=8,threads=1,free=493230400,total=536870912
> [junit4:junit4]   2> NOTE: All tests run in this JVM:
> [TestSameTokenSamePosition, TestRecyclingByteBlockAllocator,
> TestLucene40PostingsReader, TestBooleanQueryVisitSubscorers,
> TestMultiValuedNumericRangeQuery, TestForTooMuchCloning,
> TestTypePromotion, TestNRTManager, TestNumericRangeQuery32,
> TestIsCurrent, TestMockAnalyzer, TestAutomatonQuery,
> TestMultiLevelSkipList, TestForceMergeForever, TestCrash,
> TestIndexInput, TestSegmentTermEnum, TestUnicodeUtil,
> TestAttributeSource, TestDirectoryReader, TestSimpleAttributeImpl,
> TestDuelingCodecs, TestParallelAtomicReader, TestTransactions,
> TestConsistentFieldNumbers, TestDocCount, TestQueryWrapperFilter,
> TestStressIndexing, TestComplexExplanationsOfNonMatches, TestBasics,
> TestBitUtil, TestCollectionUtil, TestPayloadExplanations,
> TestTopDocsMerge, TestNewestSegment, TestDocument,
> TestCachingWrapperFilter, TestMatchAllDocsQuery, TestNoMergePolicy,
> TestToken, TestDocIdSet, TestBytesRefHash, TestVirtualMethod,
> TestReuseDocsEnum, Nested, TestDocsAndPositions, TestLock,
> TestMultiTermQueryRewrites, TestThreadedForceMerge,
> TestNRTCachingDirectory, TestBinaryDocument, TestDirectory,
> TestRamUsageEstimatorOnWildAnimals, TestIdentityHashSet,
> TestSentinelIntSet, TestWildcard, TestIndexWriterConfig,
> TestDocumentsWriterStallControl, TestParallelTermEnum,
> TestAutomatonQueryUnicode, TestLookaheadTokenFilter,
> TestTermVectorsWriter, TestRegexpRandom2,
> TestSpanMultiTermQueryWrapper, TestTermsEnum, TestSimpleExplanations,
> TestNRTReaderWithThreads, TestNumericRangeQuery64, TestSubScorerFreqs,
> TestOmitPositions, TestNumericTokenStream, TestIndexWriterMergePolicy,
> TestUniqueTermCount, TestPersistentSnapshotDeletionPolicy,
> TestPostingsFormat, TestSimilarity, TestNorms, TestByteSlices,
> TestAtomicUpdate, TestTimeLimitingCollector, TestNeverDelete,
> TestFlushByRamOrCountsPolicy, TestSort, TestIndexWriterDelete]
> [junit4:junit4]   2>
> [junit4:junit4] Completed on J1 in 70.73s, 19 tests, 1 error <<< FAILURES!
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>



-- 
lucidimagination.com

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message