lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 101 - Still Failing
Date Sat, 25 Jun 2016 08:18:31 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/101/

3 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=15774, name=updateExecutor-1877-thread-10, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15774, name=updateExecutor-1877-thread-10, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Caused by: org.apache.solr.common.SolrException: Replica: http://127.0.0.1:46388/_/yf/collection1/ should have been marked under leader initiated recovery in ZkController but wasn't.
	at __randomizedtesting.SeedInfo.seed([EA5C343185DE5A6D]:0)
	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.run(LeaderInitiatedRecoveryThread.java:88)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.handler.TestBlobHandler.doBlobHandlerTest

Error Message:
Could not find collection : .system

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : .system
	at __randomizedtesting.SeedInfo.seed([EA5C343185DE5A6D:A9D16633E322C9F]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:192)
	at org.apache.solr.handler.TestBlobHandler.doBlobHandlerTest(TestBlobHandler.java:72)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 18 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 18 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
	at __randomizedtesting.SeedInfo.seed([EA5C343185DE5A6D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:257)
	at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12099 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/init-core-data-001
   [junit4]   2> 1725854 INFO  (SUITE-ChaosMonkeySafeLeaderTest-seed#[EA5C343185DE5A6D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1725854 INFO  (SUITE-ChaosMonkeySafeLeaderTest-seed#[EA5C343185DE5A6D]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_/yf
   [junit4]   2> 1725856 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1725857 INFO  (Thread-7824) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1725857 INFO  (Thread-7824) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1725957 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ZkTestServer start zk server on port:37514
   [junit4]   2> 1725957 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1725957 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725959 INFO  (zkCallback-1864-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4fd54742 name:ZooKeeperConnection Watcher:127.0.0.1:37514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1725959 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725960 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1725960 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1725962 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1725962 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1725963 INFO  (zkCallback-1865-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3010513b name:ZooKeeperConnection Watcher:127.0.0.1:37514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1725963 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1725963 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1725963 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1725964 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1725965 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1725965 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1725966 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1725966 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1725967 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1725967 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1725968 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1725968 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1725969 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1725969 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1725970 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1725970 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1725971 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1725971 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1725972 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1725972 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1725972 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1725973 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1725973 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1725973 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1725974 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1725974 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1725975 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1725975 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1726037 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1
   [junit4]   2> 1726039 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1726040 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@630a645c{/_/yf,null,AVAILABLE}
   [junit4]   2> 1726042 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.ServerConnector Started ServerConnector@512457a4{HTTP/1.1,[http/1.1]}{127.0.0.1:41173}
   [junit4]   2> 1726042 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.Server Started @1728976ms
   [junit4]   2> 1726042 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/tempDir-001/control/data, hostContext=/_/yf, hostPort=41173, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores}
   [junit4]   2> 1726042 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1726042 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001'
   [junit4]   2> 1726043 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1726044 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1726044 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1726048 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1726048 INFO  (zkCallback-1866-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@60f74392 name:ZooKeeperConnection Watcher:127.0.0.1:37514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1726048 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1726049 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1726050 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1726050 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/solr.xml
   [junit4]   2> 1726057 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores
   [junit4]   2> 1726057 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1005879036
   [junit4]   2> 1726057 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001]
   [junit4]   2> 1726057 WARN  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/lib
   [junit4]   2> 1726057 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1726058 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1726058 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1726059 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1726063 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37514/solr
   [junit4]   2> 1726063 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1726063 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1726065 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1726065 INFO  (zkCallback-1869-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@683c8de name:ZooKeeperConnection Watcher:127.0.0.1:37514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1726066 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1726066 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1726067 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$54/586631796@24368f9
   [junit4]   2> 1726071 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1726071 INFO  (zkCallback-1870-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e85e6ac name:ZooKeeperConnection Watcher:127.0.0.1:37514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1726071 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1726073 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1726074 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1726075 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1726075 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1726076 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1726076 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1726077 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1726077 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1726077 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1726078 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1726078 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1726078 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1726079 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1726079 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1726080 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1726080 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000
   [junit4]   2> 1726080 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41173__%2Fyf
   [junit4]   2> 1726080 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1726080 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer Overseer (id=96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) starting
   [junit4]   2> 1726081 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1726085 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1726085 INFO  (OverseerCollectionConfigSetProcessor-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1726085 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1726096 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41173__%2Fyf
   [junit4]   2> 1726099 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:41173__%2Fyf
   [junit4]   2> 1726102 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1726109 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1726109 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1726110 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores
   [junit4]   2> 1726111 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1726111 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1
   [junit4]   2> 1726111 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1726130 INFO  (zkCallback-1870-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1726131 INFO  (zkCallback-1870-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1726131 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1726131 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1726131 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ZkController Collection control_collection not visible yet, but flagging it so a watch is registered when it becomes visible
   [junit4]   2> 1726132 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 1726143 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 1726144 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1726144 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1726144 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:41173/_/yf",
   [junit4]   2>   "node_name":"127.0.0.1:41173__%2Fyf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1726144 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:41173/_/yf",
   [junit4]   2>   "node_name":"127.0.0.1:41173__%2Fyf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1726144 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1726145 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1726145 INFO  (zkCallback-1870-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1727145 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1727145 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1727145 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1727145 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1727145 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1727145 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1'
   [junit4]   2> 1727146 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1727146 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1727147 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1727150 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1727153 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
   [junit4]   2> 1727159 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1727163 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1727225 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1727225 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1727226 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1727227 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1727237 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 1727237 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1727237 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
   [junit4]   2> 1727237 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data/]
   [junit4]   2> 1727237 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cb61a53
   [junit4]   2> 1727238 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data
   [junit4]   2> 1727238 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1727238 WARN  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1727239 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data/index
   [junit4]   2> 1727239 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=7, maxMergeAtOnceExplicit=4, maxMergedSegmentMB=55.7783203125, floorSegmentMB=2.1025390625, forceMergeDeletesPctAllowed=25.680939854825613, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1204208057105391
   [junit4]   2> 1727252 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 1727252 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1727252 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data/
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1727254 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1727255 WARN  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1727256 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1727256 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1727257 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1727257 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1727259 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/dump,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 1727259 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1727260 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1727260 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1727260 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 1727260 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1727261 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=7, maxMergeAtOnceExplicit=2, maxMergedSegmentMB=69.38671875, floorSegmentMB=0.8916015625, forceMergeDeletesPctAllowed=24.889220256331463, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1727261 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 1727262 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1727262 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@71d3d4f0[collection1] main]
   [junit4]   2> 1727262 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1727263 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1727264 INFO  (searcherExecutor-4338-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@71d3d4f0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1727264 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1727264 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1727264 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1727264 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1538092652288802816
   [junit4]   2> 1727266 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1538092652288802816
   [junit4]   2> 1727266 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1727267 INFO  (coreLoadExecutor-4337-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1727267 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:41173/_/yf collection:control_collection shard:shard1
   [junit4]   2> 1727267 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1727269 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/96130790675906564-core_node1-n_0000000000
   [junit4]   2> 1727269 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 1727270 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1727270 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1727270 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41173/_/yf/collection1/
   [junit4]   2> 1727270 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1727270 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1727271 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:41173/_/yf/collection1/ has no replicas
   [junit4]   2> 1727271 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1727272 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/96130790675906564-core_node1-n_0000000000
   [junit4]   2> 1727273 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41173/_/yf/collection1/ shard1
   [junit4]   2> 1727274 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:41173/_/yf",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1727376 INFO  (zkCallback-1870-thread-3-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1727424 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:41173/_/yf/collection1/ and leader is http://127.0.0.1:41173/_/yf/collection1/
   [junit4]   2> 1727424 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:41173/_/yf
   [junit4]   2> 1727425 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1727425 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1727425 INFO  (coreZkRegister-4331-thread-1-processing-n:127.0.0.1:41173__%2Fyf x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:41173__%2Fyf c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1727426 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:41173/_/yf",
   [junit4]   2>   "node_name":"127.0.0.1:41173__%2Fyf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1727426 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:41173/_/yf",
   [junit4]   2>   "node_name":"127.0.0.1:41173__%2Fyf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1727528 INFO  (zkCallback-1870-thread-1-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1727645 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1727652 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1727653 INFO  (zkCallback-1874-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@779dd8d6 name:ZooKeeperConnection Watcher:127.0.0.1:37514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1727653 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1727653 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1727653 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1727654 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1727655 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1727658 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1727658 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1727658 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1727663 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1727669 INFO  (zkCallback-1875-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@703c9023 name:ZooKeeperConnection Watcher:127.0.0.1:37514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1727669 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1727669 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1727670 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 1727670 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1727755 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/cores/collection1
   [junit4]   2> 1727755 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001
   [junit4]   2> 1727756 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@78391a7{/_/yf,null,AVAILABLE}
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.ServerConnector Started ServerConnector@69cc729e{HTTP/1.1,[http/1.1]}{127.0.0.1:35089}
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.Server Started @1730700ms
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/_/yf, hostPort=35089, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/cores}
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001'
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1727766 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1727767 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1727767 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1727769 INFO  (zkCallback-1876-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3811d933 name:ZooKeeperConnection Watcher:127.0.0.1:37514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1727769 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1727769 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1727770 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1727770 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/solr.xml
   [junit4]   2> 1727780 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1727783 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/cores
   [junit4]   2> 1727783 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CoreContainer New CoreContainer 182566829
   [junit4]   2> 1727783 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001]
   [junit4]   2> 1727783 WARN  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/lib
   [junit4]   2> 1727783 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1727785 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1727785 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1727785 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1727785 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37514/solr
   [junit4]   2> 1727785 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1727785 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1727796 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1727800 INFO  (zkCallback-1879-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d2e8c98 name:ZooKeeperConnection Watcher:127.0.0.1:37514 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1727800 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1727800 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1727801 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$54/586631796@5969ad3f
   [junit4]   2> 1727803 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1727803 INFO  (zkCallback-1880-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a51dd93 name:ZooKeeperConnection Watcher:127.0.0.1:37514/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1727803 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1727805 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1727806 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1727806 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1727807 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1727807 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96130790675906569-127.0.0.1:35089__%2Fyf-n_0000000001
   [junit4]   2> 1727807 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000 to know if I could be the leader
   [junit4]   2> 1727807 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.ZkController Publish node=127.0.0.1:35089__%2Fyf as DOWN
   [junit4]   2> 1727808 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:35089__%2Fyf"} current state version: 3
   [junit4]   2> 1727808 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:35089__%2Fyf
   [junit4]   2> 1727809 INFO  (zkCallback-1874-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1727809 INFO  (zkCallback-1880-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1727809 INFO  (zkCallback-1870-thread-3-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1727915 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 1728808 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35089__%2Fyf
   [junit4]   2> 1728809 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35089__%2Fyf
   [junit4]   2> 1728810 INFO  (zkCallback-1874-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1728810 INFO  (zkCallback-1870-thread-3-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1728810 INFO  (zkCallback-1874-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1728810 INFO  (zkCallback-1870-thread-3-processing-n:127.0.0.1:41173__%2Fyf) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1728812 INFO  (zkCallback-1880-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1728813 INFO  (zkCallback-1880-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1728852 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1728852 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1728852 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/cores
   [junit4]   2> 1728853 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1728853 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.ChaosMonkeySafeLeaderTest_EA5C343185DE5A6D-001/shard-1-001/cores/collection1
   [junit4]   2> 1728853 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[EA5C343185DE5A6D]) [n:127.0.0.1:35089__%2Fyf    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1728854 INFO  (coreLoadExecutor-4348-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1728854 INFO  (coreLoadExecutor-4348-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1728855 INFO  (coreLoadExecutor-4348-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 1728856 INFO  (coreLoadExecutor-4348-thread-1-processing-n:127.0.0.1:35089__%2Fyf) [n:127.0.0.1:35089__%2Fyf c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for [collection1] ver [1]
   [junit4]   2> 1728856 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35089/_/yf",
   [junit4]   2>   "node_name":"127.0.0.1:35089__%2Fyf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 4
   [junit4]   2> 1728856 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35089/_/yf",
   [junit4]   2>   "node_name":"127.0.0.1:35089__%2Fyf",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1728856 INFO  (OverseerStateUpdate-96130790675906564-127.0.0.1:41173__%2Fyf-n_0000000000) [n:127.0.0.1:41173__%2Fyf    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=

[...truncated too long message...]

  [junit4]   2> 4444714 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[EA5C343185DE5A6D]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@25dbe84{/,null,UNAVAILABLE}
   [junit4]   2> 4444715 INFO  (TEST-TestBlobHandler.doBlobHandlerTest-seed#[EA5C343185DE5A6D]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34193 34193
   [junit4]   2> 4444839 INFO  (Thread-67191) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34193 34193
   [junit4]   2> 4444840 WARN  (Thread-67191) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	4	/solr/collections/collection1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/.system/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	46	/solr/overseer/collection-queue-work
   [junit4]   2> 	42	/solr/overseer/queue
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	6	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBlobHandler -Dtests.method=doBlobHandlerTest -Dtests.seed=EA5C343185DE5A6D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=it-CH -Dtests.timezone=Europe/Mariehamn -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   49.7s J0 | TestBlobHandler.doBlobHandlerTest <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : .system
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EA5C343185DE5A6D:A9D16633E322C9F]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:192)
   [junit4]    > 	at org.apache.solr.handler.TestBlobHandler.doBlobHandlerTest(TestBlobHandler.java:72)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 4444842 INFO  (SUITE-TestBlobHandler-seed#[EA5C343185DE5A6D]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.handler.TestBlobHandler_EA5C343185DE5A6D-001
   [junit4]   2> Jun 25, 2016 8:09:36 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=ClassicSimilarity, locale=it-CH, timezone=Europe/Mariehamn
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=94905224,total=503316480
   [junit4]   2> NOTE: All tests run in this JVM: [TlogReplayBufferedWhileIndexingTest, TestConfigSetsAPIExclusivity, StandardRequestHandlerTest, TestSolrXml, BigEndianAscendingWordDeserializerTest, TestInitParams, SuggestComponentTest, PreAnalyzedUpdateProcessorTest, EchoParamsTest, TestSizeLimitedDistributedMap, EnumFieldTest, CollectionTooManyReplicasTest, TestFilteredDocIdSet, TestSchemaVersionResource, TestFunctionQuery, TestRawResponseWriter, HLLUtilTest, DocumentAnalysisRequestHandlerTest, IndexSchemaTest, JsonLoaderTest, TestSolrQueryParserResource, TestOmitPositions, CoreAdminRequestStatusTest, TestCrossCoreJoin, TestAtomicUpdateErrorCases, TestSolrFieldCacheMBean, TestPhraseSuggestions, AnalysisAfterCoreReloadTest, MergeStrategyTest, PreAnalyzedFieldTest, BasicDistributedZkTest, AnalyticsMergeStrategyTest, TestSubQueryTransformerCrossCore, TestFastOutputStream, CloudExitableDirectoryReaderTest, DistributedQueryComponentCustomSortTest, PolyFieldTest, DataDrivenBlockJoinTest, ResponseLogComponentTest, TestConfigSetImmutable, ReturnFieldsTest, TestHighFrequencyDictionaryFactory, TestReqParamsAPI, DistribJoinFromCollectionTest, TestCustomDocTransformer, TestMergePolicyConfig, MultiThreadedOCPTest, ConnectionReuseTest, TestShardHandlerFactory, SignatureUpdateProcessorFactoryTest, XsltUpdateRequestHandlerTest, TestSortingResponseWriter, TestRecoveryHdfs, QueryElevationComponentTest, DeleteLastCustomShardedReplicaTest, DisMaxRequestHandlerTest, TestLuceneMatchVersion, ResourceLoaderTest, CreateCollectionCleanupTest, PeerSyncTest, TestCloudManagedSchema, ChangedSchemaMergeTest, AsyncCallRequestStatusResponseTest, ExplicitHLLTest, TestPKIAuthenticationPlugin, TestSolr4Spatial, TestHdfsUpdateLog, TestLMDirichletSimilarityFactory, TestComponentsName, SystemInfoHandlerTest, DistributedSpellCheckComponentTest, HdfsChaosMonkeySafeLeaderTest, TestRequestStatusCollectionAPI, CacheHeaderTest, RAMDirectoryFactoryTest, TestExactSharedStatsCache, TestArbitraryIndexDir, TestBadConfig, CursorPagingTest, SolrCoreTest, TestRebalanceLeaders, TestRangeQuery, TestDocTermOrds, OutputWriterTest, ReplicationFactorTest, AtomicUpdatesTest, TestDistributedSearch, TestCloudPivotFacet, TestConfigReload, DistributedFacetPivotSmallAdvancedTest, TestLRUCache, TestLazyCores, TestMinMaxOnMultiValuedField, UUIDUpdateProcessorFallbackTest, TestPivotHelperCode, HdfsUnloadDistributedZkTest, HighlighterMaxOffsetTest, TestDocSet, TestManagedSynonymFilterFactory, DateFieldTest, DefaultValueUpdateProcessorTest, TestJoin, CollectionsAPIDistributedZkTest, OverseerTest, ShardRoutingTest, ClusterStateUpdateTest, TestRandomFaceting, ZkSolrClientTest, TestRandomDVFaceting, ShardRoutingCustomTest, TestFaceting, TestHashPartitioner, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestStressVersions, DistributedTermsComponentTest, TestCoreContainer, SimpleFacetsTest, SolrCmdDistributorTest, TestSort, TestFiltering, DirectUpdateHandlerTest, TestIndexSearcher, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, TestExtendedDismaxParser, SpellCheckCollatorTest, SolrRequestParserTest, TestFoldingMultitermQuery, DocValuesTest, TestStressLucene, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, QueryEqualityTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, TestQueryUtils, DirectSolrSpellCheckerTest, TestQueryTypes, XmlUpdateRequestHandlerTest, TestValueSourceCache, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, TestCollationField, TestCSVResponseWriter, TestPHPSerializedResponseWriter, PingRequestHandlerTest, SOLR749Test, UpdateParamsTest, CopyFieldTest, TestSearchPerf, TestConfig, ExternalFileFieldSortTest, TestCharFilters, SynonymTokenizerTest, TestXIncludeConfig, TestPerFieldSimilarity, TestIBSimilarityFactory, TestFastWriter, OpenExchangeRatesOrgProviderTest, PluginInfoTest, PrimUtilsTest, DOMUtilTest, TestUtils, ZkNodePropsTest, UUIDFieldTest, DistributedMLTComponentTest, TestHighlightDedupGrouping, ActionThrottleTest, AsyncMigrateRouteKeyTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, ConcurrentDeleteAndCreateCollectionTest, DeleteReplicaTest, DeleteStatusTest, DistributedQueueTest, DistributedVersionInfoTest, HttpPartitionTest, LeaderInitiatedRecoveryOnCommitTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, RemoteQueryErrorTest, SSLMigrationTest, SaslZkACLProviderTest, ShardSplitTest, TestDistribDocBasedVersion, TestLeaderInitiatedRecoveryThread, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TriLevelCompositeIdRoutingTest, HdfsCollectionsAPIDistributedZkTest, TestClusterStateMutator, ZkStateReaderTest, DirectoryFactoryTest, HdfsDirectoryFactoryTest, TestNRTOpen, TestBlobHandler]
   [junit4] Completed [511/617 (3!)] on J0 in 50.48s, 1 test, 1 error <<< FAILURES!

[...truncated 334 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:530: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1427: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:984: There were test failures: 617 suites (10 ignored), 2597 tests, 1 suite-level error, 2 errors, 33 ignored (18 assumptions) [seed: EA5C343185DE5A6D]

Total time: 267 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




Mime
View raw message