lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 914 - Still Failing
Date Tue, 19 Jan 2016 17:02:35 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/914/

4 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange

Error Message:
Timeout while trying to assert number of documents @ target_collection

Stack Trace:
java.lang.AssertionError: Timeout while trying to assert number of documents @ target_collection
	at __randomizedtesting.SeedInfo.seed([E5B42878BDF7DD6D:3744649BE3587B5F]:0)
	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:265)
	at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterLeaderChange(CdcrReplicationDistributedZkTest.java:292)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: expected:<10> but was:<4>
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.junit.Assert.assertEquals(Assert.java:456)
	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.assertNumDocs(BaseCdcrDistributedZkTest.java:256)
	... 42 more


FAILED:  org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test

Error Message:
document count mismatch.  control=1210 sum(shards)=1212 cloudClient=1212

Stack Trace:
java.lang.AssertionError: document count mismatch.  control=1210 sum(shards)=1212 cloudClient=1212
	at __randomizedtesting.SeedInfo.seed([E5B42878BDF7DD6D:6DE017A2130BB095]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1318)
	at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:225)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=15002, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=15002, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:38158: collection already exists: awholynewstresscollection_collection1_0
	at __randomizedtesting.SeedInfo.seed([E5B42878BDF7DD6D]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:576)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1594)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1615)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:887)


FAILED:  org.apache.solr.cloud.hdfs.StressHdfsTest.test

Error Message:
No registered leader was found after waiting for 30000ms , collection: delete_data_dir slice: shard4

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 30000ms , collection: delete_data_dir slice: shard4
	at __randomizedtesting.SeedInfo.seed([E5B42878BDF7DD6D:6DE017A2130BB095]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:603)
	at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:161)
	at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:100)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10694 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/init-core-data-001
   [junit4]   2> 2111425 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[E5B42878BDF7DD6D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 2111425 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[E5B42878BDF7DD6D]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 2111428 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2111428 INFO  (Thread-8629) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2111428 INFO  (Thread-8629) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2111528 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.ZkTestServer start zk server on port:41465
   [junit4]   2> 2111528 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2111529 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2111532 INFO  (zkCallback-1864-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ca2ec2 name:ZooKeeperConnection Watcher:127.0.0.1:41465 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2111532 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2111532 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2111532 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2111539 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2111540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2111541 INFO  (zkCallback-1865-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@780b16c name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2111541 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2111541 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2111541 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 2111543 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 2111544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 2111545 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 2111551 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2111551 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2111553 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 2111553 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 2111555 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2111555 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2111556 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2111556 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2111558 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2111558 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2111559 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2111559 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 2111560 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2111560 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2111562 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2111562 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2111563 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2111563 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2111566 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2111566 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2111567 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2111567 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2111569 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2111570 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2111571 INFO  (zkCallback-1866-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d530720 name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2111571 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2111571 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2111911 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1
   [junit4]   2> 2111912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 2111914 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@72f9fd92{/,null,AVAILABLE}
   [junit4]   2> 2111920 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.ServerConnector Started ServerConnector@7ee60272{SSL-http/1.1}{127.0.0.1:33921}
   [junit4]   2> 2111921 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.Server Started @2115710ms
   [junit4]   2> 2111921 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/tempDir-001/control/data, hostContext=/, hostPort=33921, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores}
   [junit4]   2> 2111921 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 2111921 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001'
   [junit4]   2> 2111921 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2111921 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2111922 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2111927 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2111928 INFO  (zkCallback-1867-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@509ae089 name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2111928 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2111928 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2111929 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2111929 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/solr.xml
   [junit4]   2> 2111935 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores
   [junit4]   2> 2111935 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1169847949
   [junit4]   2> 2111935 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001]
   [junit4]   2> 2111935 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/lib
   [junit4]   2> 2111936 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 2111938 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 2111939 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2111939 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2111940 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41465/solr
   [junit4]   2> 2111940 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 2111940 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2111943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2111943 INFO  (zkCallback-1870-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2c8fa775 name:ZooKeeperConnection Watcher:127.0.0.1:41465 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2111943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2111943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2111945 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2111945 INFO  (zkCallback-1871-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f762734 name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2111946 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2111947 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 2111949 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 2111952 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 2111953 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 2111955 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 2111958 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2111959 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2111960 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2111961 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2111962 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33921_
   [junit4]   2> 2111962 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33921_
   [junit4]   2> 2111964 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 2111965 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 2111966 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2111967 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95238008251613189-127.0.0.1:33921_-n_0000000000
   [junit4]   2> 2111967 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33921_
   [junit4]   2> 2111967 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 2111968 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer Overseer (id=95238008251613189-127.0.0.1:33921_-n_0000000000) starting
   [junit4]   2> 2111970 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 2111975 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2111976 INFO  (OverseerCollectionConfigSetProcessor-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 2111976 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2111977 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2111992 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 2111992 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 2111993 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores
   [junit4]   2> 2111994 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 2111994 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1
   [junit4]   2> 2111994 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 2111995 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 2111995 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:33921_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 2111996 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 2111996 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 2111997 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:33921",
   [junit4]   2>   "node_name":"127.0.0.1:33921_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 2111997 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 2111998 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:33921",
   [junit4]   2>   "node_name":"127.0.0.1:33921_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2111998 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 2111999 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 2112000 INFO  (zkCallback-1871-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2112998 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2112998 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 2112998 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 2112998 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 2112999 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 2112999 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1'
   [junit4]   2> 2112999 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2112999 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2113001 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 2113006 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 2113010 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 2113019 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2113024 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2113113 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2113119 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 2113120 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 2113135 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 2113137 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 2113139 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2113140 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2113141 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 2113141 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 2113141 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2113141 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1/data/]
   [junit4]   2> 2113142 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c7f8962
   [junit4]   2> 2113142 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1/data
   [junit4]   2> 2113142 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1/data/index/
   [junit4]   2> 2113142 WARN  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 2113142 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1/data/index
   [junit4]   2> 2113143 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=1.322265625, noCFSRatio=0.5094017298449398]
   [junit4]   2> 2113143 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=RawDirectoryWrapper(RAMDirectory@36df8d1e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10ab7f66),segFN=segments_1,generation=1}
   [junit4]   2> 2113143 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 2113144 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1/data/
   [junit4]   2> 2113144 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 2113146 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2113146 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2113146 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2113146 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2113146 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2113147 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2113147 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2113147 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2113147 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2113147 WARN  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 2113149 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2113150 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2113150 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2113151 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 2113154 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 2113155 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 2113155 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2113155 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2113156 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2113156 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2113156 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@28e9a13e
   [junit4]   2> 2113157 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=RawDirectoryWrapper(RAMDirectory@36df8d1e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10ab7f66),segFN=segments_1,generation=1}
   [junit4]   2> 2113157 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 2113157 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@69f38768[collection1] main]
   [junit4]   2> 2113157 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 2113158 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 2113158 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2113159 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2113159 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 2113159 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2113159 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2113159 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2113159 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 2113159 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2113160 INFO  (searcherExecutor-3056-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@69f38768[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2113160 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 2113160 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 2113160 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 2113160 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1523808133840896000
   [junit4]   2> 2113163 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1523808133840896000
   [junit4]   2> 2113163 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 2113163 INFO  (coreLoadExecutor-3055-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 2113164 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:33921 collection:control_collection shard:shard1
   [junit4]   2> 2113164 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2113167 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95238008251613189-core_node1-n_0000000000
   [junit4]   2> 2113167 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 2113169 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2113169 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2113169 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33921/collection1/
   [junit4]   2> 2113169 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2113169 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 2113169 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:33921/collection1/ has no replicas
   [junit4]   2> 2113170 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2113172 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 2113173 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33921/collection1/ shard1
   [junit4]   2> 2113174 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:33921",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 2113276 INFO  (zkCallback-1871-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2113325 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:33921/collection1/ and leader is https://127.0.0.1:33921/collection1/
   [junit4]   2> 2113325 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:33921
   [junit4]   2> 2113325 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2113325 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 2113325 INFO  (coreZkRegister-3049-thread-1-processing-n:127.0.0.1:33921_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:33921_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 2113327 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:33921",
   [junit4]   2>   "node_name":"127.0.0.1:33921_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 2113328 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:33921",
   [junit4]   2>   "node_name":"127.0.0.1:33921_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 2113430 INFO  (zkCallback-1871-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2113499 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2113499 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2113501 INFO  (zkCallback-1873-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@622faa40 name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2113501 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2113501 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2113501 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2113504 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2113504 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 2113504 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2113504 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2113506 INFO  (zkCallback-1874-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5bfefbd name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2113506 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2113506 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2113508 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 2113508 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 2113616 INFO  (OverseerStateUpdate-95238008251613189-127.0.0.1:33921_-n_0000000000) [n:127.0.0.1:33921_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 2113846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/cores/collection1
   [junit4]   2> 2113847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001
   [junit4]   2> 2113848 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 2113850 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@743c1480{/,null,AVAILABLE}
   [junit4]   2> 2113855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.ServerConnector Started ServerConnector@340d1526{SSL-http/1.1}{127.0.0.1:35607}
   [junit4]   2> 2113855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.Server Started @2117644ms
   [junit4]   2> 2113855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=35607, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/cores}
   [junit4]   2> 2113855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 2113855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001'
   [junit4]   2> 2113855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2113855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2113856 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2113856 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2113857 INFO  (zkCallback-1875-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@286d651d name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2113857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2113857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2113858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2113858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/solr.xml
   [junit4]   2> 2113863 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/cores
   [junit4]   2> 2113864 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1167038711
   [junit4]   2> 2113864 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001]
   [junit4]   2> 2113864 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/lib
   [junit4]   2> 2113864 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 2113866 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 2113867 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2113868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2113868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41465/solr
   [junit4]   2> 2113868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 2113868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2113868 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2113869 INFO  (zkCallback-1878-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@313a55e4 name:ZooKeeperConnection Watcher:127.0.0.1:41465 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2113870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2113870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2113879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2113879 INFO  (zkCallback-1879-thread-1-processing-n:127.0.0.1:35607_) [n:127.0.0.1:35607_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ef7c2df name:ZooKeeperConnection Watcher:127.0.0.1:41465/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2113879 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2113886 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2114891 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35607_
   [junit4]   2> 2114892 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35607_
   [junit4]   2> 2114893 INFO  (zkCallback-1873-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2114893 INFO  (zkCallback-1871-thread-1-processing-n:127.0.0.1:33921_) [n:127.0.0.1:33921_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2114894 INFO  (zkCallback-1879-thread-1-processing-n:127.0.0.1:35607_) [n:127.0.0.1:35607_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2114896 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2114896 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95238008251613194-127.0.0.1:35607_-n_0000000001
   [junit4]   2> 2114897 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95238008251613189-127.0.0.1:33921_-n_0000000000 to know if I could be the leader
   [junit4]   2> 2114909 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 2114909 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 2114910 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/cores
   [junit4]   2> 2114911 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 2114911 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_E5B42878BDF7DD6D-001/shard-1-001/cores/collection1
   [junit4]   2> 2114911 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 2114912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:35607_    ] o.a

[...truncated too long message...]

erseer (id=95238244945625120-127.0.0.1:48870_-n_0000000007) closing
   [junit4]   2> 5789204 INFO  (OverseerStateUpdate-95238244945625120-127.0.0.1:48870_-n_0000000007) [n:127.0.0.1:48870_    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:48870_
   [junit4]   2> 5789204 INFO  (zkCallback-3879-thread-1-processing-n:127.0.0.1:48870_) [n:127.0.0.1:48870_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 5789205 WARN  (zkCallback-3879-thread-1-processing-n:127.0.0.1:48870_) [n:127.0.0.1:48870_    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 5789206 INFO  (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@136fd5ed{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 5789207 INFO  (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[E5B42878BDF7DD6D]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@47cae420{/,null,UNAVAILABLE}
   [junit4]   2> 5789207 INFO  (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:48870_ c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica2] o.a.s.SolrTestCaseJ4 ###Ending testResilienceWithDeleteByQueryOnTarget
   [junit4]   2> 5789208 INFO  (TEST-CdcrReplicationDistributedZkTest.testResilienceWithDeleteByQueryOnTarget-seed#[E5B42878BDF7DD6D]) [n:127.0.0.1:48870_ c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica2] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60008 60008
   [junit4]   2> 5789344 INFO  (Thread-45629) [n:127.0.0.1:39362_ c:target_collection s:shard1 r:core_node1 x:target_collection_shard1_replica1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60008 60008
   [junit4]   2> 5789346 WARN  (Thread-45629) [n:127.0.0.1:39362_ c:target_collection s:shard1 r:core_node1 x:target_collection_shard1_replica1] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	39	/solr/aliases.json
   [junit4]   2> 	16	/solr/configs/conf1
   [junit4]   2> 	8	/solr/security.json
   [junit4]   2> 	2	/solr/collections/source_collection/leaders/shard1/leader
   [junit4]   2> 	2	/solr/collections/source_collection/leaders/shard2/leader
   [junit4]   2> 	2	/solr/collections/tmp_collection/leaders/shard2/leader
   [junit4]   2> 	2	/solr/collections/target_collection/leaders/shard2/leader
   [junit4]   2> 	2	/solr/collections/tmp_collection/leaders/shard1/leader
   [junit4]   2> 	2	/solr/collections/target_collection/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	39	/solr/clusterstate.json
   [junit4]   2> 	8	/solr/collections/tmp_collection/cdcr/state/process
   [junit4]   2> 	8	/solr/collections/tmp_collection/cdcr/state/buffer
   [junit4]   2> 	7	/solr/collections/source_collection/cdcr/state/process
   [junit4]   2> 	4	/solr/collections/target_collection/cdcr/state/buffer
   [junit4]   2> 	4	/solr/collections/source_collection/state.json
   [junit4]   2> 	4	/solr/collections/source_collection/cdcr/state/buffer
   [junit4]   2> 	4	/solr/collections/target_collection/cdcr/state/process
   [junit4]   2> 	4	/solr/collections/target_collection/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	39	/solr/live_nodes
   [junit4]   2> 	39	/solr/collections
   [junit4]   2> 	8	/solr/overseer/collection-queue-work
   [junit4]   2> 	7	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 5789347 INFO  (SUITE-CdcrReplicationDistributedZkTest-seed#[E5B42878BDF7DD6D]-worker) [n:127.0.0.1:48870_ c:target_collection s:shard2 r:core_node4 x:target_collection_shard2_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_E5B42878BDF7DD6D-001
   [junit4]   2> Jan 19, 2016 4:19:16 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {_version_=Lucene50(blocksize=128), id=PostingsFormat(name=MockRandom)}, docValues:{}, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=en-PH, timezone=America/Grand_Turk
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=170381080,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: [BadIndexSchemaTest, TestSearcherReuse, TermVectorComponentDistributedTest, CdcrRequestHandlerTest, CoreAdminHandlerTest, RecoveryZkTest, ExplicitHLLTest, ConcurrentDeleteAndCreateCollectionTest, TestXIncludeConfig, TestSolrJ, CoreMergeIndexesAdminHandlerTest, SolrCoreCheckLockOnStartupTest, LeaderElectionTest, TestDownShardTolerantSearch, DebugComponentTest, TestCoreDiscovery, DataDrivenBlockJoinTest, ShardSplitTest, TestManagedResourceStorage, ShowFileRequestHandlerTest, DocValuesMultiTest, TestSolrIndexConfig, PrimitiveFieldTypeTest, StatelessScriptUpdateProcessorFactoryTest, TestSolrQueryParser, CachingDirectoryFactoryTest, SliceStateTest, TestHashQParserPlugin, TestSolrDeletionPolicy1, NoCacheHeaderTest, TestClassNameShortening, UpdateParamsTest, HLLUtilTest, TestMissingGroups, TestJmxMonitoredMap, BasicDistributedZk2Test, OverseerStatusTest, StatsComponentTest, TestMinMaxOnMultiValuedField, SimpleFacetsTest, TestRebalanceLeaders, FullSolrCloudDistribCmdsTest, CleanupOldIndexTest, TestSort, TestExtendedDismaxParser, TestQueryWrapperFilter, CollectionStateFormat2Test, BaseCdcrDistributedZkTest, OverseerTest, SuggesterTSTTest, TestIndexingPerformance, HdfsRecoveryZkTest, DirectSolrConnectionTest, TestIndexSearcher, TestHdfsUpdateLog, HardAutoCommitTest, LeaderFailoverAfterPartitionTest, DateMathParserTest, TestPerFieldSimilarity, OverriddenZkACLAndCredentialsProvidersTest, TestSchemaSimilarityResource, DirectUpdateHandlerTest, SampleTest, XmlUpdateRequestHandlerTest, TestManagedSchemaDynamicFieldResource, TestCloudManagedSchema, FieldAnalysisRequestHandlerTest, TestRecovery, CurrencyFieldXmlFileTest, DistributedFacetPivotLargeTest, HdfsBasicDistributedZkTest, SimpleMLTQParserTest, SuggesterTest, TestCharFilters, StressHdfsTest, TestTrieFacet, TestStressReorder, TestGroupingSearch, TestAuthenticationFramework, SimpleCollectionCreateDeleteTest, TestSolrConfigHandlerConcurrent, HighlighterConfigTest, TestStressRecovery, BasicAuthIntegrationTest, DistributedVersionInfoTest, RegexBoostProcessorTest, TestSuggestSpellingConverter, ZkStateWriterTest, AssignTest, PluginInfoTest, AddBlockUpdateTest, LeaderElectionIntegrationTest, ShardRoutingTest, TestReplicationHandler, ConvertedLegacyTest, CurrencyFieldOpenExchangeTest, SpellCheckCollatorTest, DocValuesTest, SpatialFilterTest, TestCSVLoader, FieldMutatingUpdateProcessorTest, QueryEqualityTest, XsltUpdateRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, TestQueryTypes, RequestHandlersTest, FastVectorHighlighterTest, LoggingHandlerTest, TestJmxIntegration, ReturnFieldsTest, TestCSVResponseWriter, BinaryUpdateRequestHandlerTest, PingRequestHandlerTest, TestBM25SimilarityFactory, TimeZoneUtilsTest, TestFastOutputStream, URLClassifyProcessorTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, AsyncCallRequestStatusResponseTest, CdcrReplicationDistributedZkTest]
   [junit4] Completed [447/577 (4!)] on J2 in 835.03s, 11 tests, 1 failure <<< FAILURES!

[...truncated 459 lines...]
   [junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J1-20160119_144243_335.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid29010.hprof ...
   [junit4] Heap dump file created [728106197 bytes in 6.165 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 24 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:791: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:728: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:524: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1424: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 577 suites (8 ignored), 2313 tests, 2 errors, 2 failures, 33 ignored (18 assumptions) [seed: E5B42878BDF7DD6D]

Total time: 270 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message