lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erick Erickson <erickerick...@gmail.com>
Subject BadApple report, PLEASE CHECK THE FIRST PART.
Date Mon, 10 Sep 2018 18:05:19 GMT
First, I have these two lists, are they still current?

DO NOT ENABLE LIST:
    'TestControlledRealTimeReopenThread.testCRTReopen'
    'TestICUNormalizer2CharFilter.testRandomStrings'
    'TestICUTokenizerCJK'
    'TestImpersonationWithHadoopAuth.testForwarding'
    'TestLTRReRankingPipeline.testDifferentTopN'
    'TestRandomChains'


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    MaxSizeAutoCommitTest
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    TestLatLonShapeQueries.testRandomBig
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate
    TestWithCollection


Second, I've gotten a bit more clarity on suite-level failures and may
be un-BadApple-ing certain of them. Basically, if all _tests_ in a
suite are annotated and we still get suite-level failures, that's
valuable information as it implicates the framework and/or
setup/teardown code in the class or superclass.

*************You can stop reading now.

  **Annotations will be removed from the following tests because they
haven't failed in the last 4 rollups.

  **Methods: 13
   AutoAddReplicasIntegrationTest.testSimple
   CloudSolrClientTest.preferReplicaTypesTest
   DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
   DocValuesNotIndexedTest.testGroupingDVOnly
   FullSolrCloudDistribCmdsTest.test
   GraphTest.testShortestPathStream
   LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
   LIRRollingUpdatesTest.testNewLeaderOldReplica
   LIRRollingUpdatesTest.testNewReplicaOldLeader
   MoveReplicaHDFSTest.testNormalFailedMove
   ScheduledTriggerIntegrationTest.testScheduledTrigger
   SolrCloudReportersTest.testDefaultPlugins
   TestHdfsCloudBackupRestore.test

  **Suites: 0


********Failures in Hoss' reports for the last 4 rollups.

There were 605 unannotated tests that failed in Hoss' rollups. Ordered
by the date I downloaded the rollup file, newest->oldest. See above
for the dates the files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there
are objections



Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123  36.4       78     34      HdfsBasicDistributedZkTest(suite)
     0123   0.5     1578      6      MetricsHistoryHandlerTest.testBasic
     0123   1.8     1308     46      MoveReplicaHDFSTest.testFailedMove
     0123   0.7     1153      8      SaslZkACLProviderTest(suite)
     0123   0.3     1156      6      SaslZkACLProviderTest.testSaslZkACLProvider
     0123   1.0     1366     12
SearchRateTriggerIntegrationTest.testBelowSearchRate
     0123   1.2     1571     15      ShardSplitTest.testSplitAfterFailedSplit
     0123   0.7     1571     23
ShardSplitTest.testSplitMixedReplicaTypesLink
     0123   4.1     1591     60      TestSQLHandler(suite)
     0123   4.2     1653     63      TestSQLHandler.doTest
     0123   0.3     1584      4      TestTlogReplica(suite)
     0123   0.5     1738      6      TestWithCollection.testNodeAdded
     0123   1.3     1619     19
ZkShardTermsTest.testParticipationOfReplicas
     0123   2.3     1466     31      ZookeeperStatusHandlerTest(suite)
************ Will BadApple all tests above this line except ones
listed at the top**************

Mime
View raw message