lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 22 - Still Failing
Date Fri, 25 Mar 2016 16:15:51 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/22/

4 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=19550, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=19550, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:58808, http://127.0.0.1:57773, http://127.0.0.1:46696, http://127.0.0.1:53019, http://127.0.0.1:50214]
	at __randomizedtesting.SeedInfo.seed([AB4EF3E1B06AF31B]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:980)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:58808, http://127.0.0.1:57773, http://127.0.0.1:46696, http://127.0.0.1:53019, http://127.0.0.1:50214]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:970)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:57773: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qnr-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 7 more


FAILED:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=5731, name=Thread-5020, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5731, name=Thread-5020, state=RUNNABLE, group=TGRP-FullSolrCloudDistribCmdsTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:42468/collection1
	at __randomizedtesting.SeedInfo.seed([AB4EF3E1B06AF31B]:0)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:644)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:42468/collection1
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest$1IndexThread.run(FullSolrCloudDistribCmdsTest.java:642)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 5 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:39164: KeeperErrorCode = ConnectionLoss for /overseer/collection-queue-work/qnr-0000000134

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39164: KeeperErrorCode = ConnectionLoss for /overseer/collection-queue-work/qnr-0000000134
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:334)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:175)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:996)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
[replication.properties, index.properties, index.20160325090005873, index.20160325090010993] expected:<1> but was:<2>

Stack Trace:
java.lang.AssertionError: [replication.properties, index.properties, index.20160325090005873, index.20160325090010993] expected:<1> but was:<2>
	at __randomizedtesting.SeedInfo.seed([AB4EF3E1B06AF31B:70E5F327B5429AA8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.handler.TestReplicationHandler.checkForSingleIndex(TestReplicationHandler.java:823)
	at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:790)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11078 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/init-core-data-001
   [junit4]   2> 122459 INFO  (SUITE-FullSolrCloudDistribCmdsTest-seed#[AB4EF3E1B06AF31B]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 122462 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 122463 INFO  (Thread-4843) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 122463 INFO  (Thread-4843) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 122563 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.ZkTestServer start zk server on port:49900
   [junit4]   2> 122563 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 122564 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 122566 INFO  (zkCallback-63-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7165efc8 name:ZooKeeperConnection Watcher:127.0.0.1:49900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 122566 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 122567 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 122567 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 122573 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 122576 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 122578 INFO  (zkCallback-64-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4e461606 name:ZooKeeperConnection Watcher:127.0.0.1:49900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 122578 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 122578 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 122578 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 122582 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 122584 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 122588 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 122589 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 122590 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 122592 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 122593 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 122594 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 122595 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 122600 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 122600 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 122601 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 122601 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 122603 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 122603 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 122605 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 122605 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 122606 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 122607 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 122608 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 122608 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 122610 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 122610 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 122611 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 122611 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 122708 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1
   [junit4]   2> 122710 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 122712 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7954b976{/,null,AVAILABLE}
   [junit4]   2> 122724 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@16f81b26{HTTP/1.1,[http/1.1]}{127.0.0.1:42468}
   [junit4]   2> 122724 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.Server Started @125869ms
   [junit4]   2> 122724 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/tempDir-001/control/data, hostContext=/, hostPort=42468, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores}
   [junit4]   2> 122725 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 122726 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001'
   [junit4]   2> 122726 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 122726 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 122726 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 122729 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 122734 INFO  (zkCallback-65-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@41adf849 name:ZooKeeperConnection Watcher:127.0.0.1:49900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 122734 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 122734 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 122736 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 122736 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/solr.xml
   [junit4]   2> 122742 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores
   [junit4]   2> 122742 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CoreContainer New CoreContainer 1580470030
   [junit4]   2> 122742 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001]
   [junit4]   2> 122743 WARN  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/lib
   [junit4]   2> 122743 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 122744 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 122745 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 122745 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 122745 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49900/solr
   [junit4]   2> 122745 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 122745 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 122749 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 122752 INFO  (zkCallback-68-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3025b070 name:ZooKeeperConnection Watcher:127.0.0.1:49900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 122761 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 122761 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 122764 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 122765 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6c2095bd name:ZooKeeperConnection Watcher:127.0.0.1:49900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 122765 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 122767 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 122769 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 122771 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 122773 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 122774 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 122776 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 122778 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 122779 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 122780 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 122781 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 122784 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 122787 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 122788 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 122789 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 122789 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95611367015841796-127.0.0.1:42468_-n_0000000000
   [junit4]   2> 122790 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42468_
   [junit4]   2> 122790 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 122791 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer Overseer (id=95611367015841796-127.0.0.1:42468_-n_0000000000) starting
   [junit4]   2> 122793 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 122799 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 122800 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 122805 INFO  (OverseerCollectionConfigSetProcessor-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 122814 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42468_
   [junit4]   2> 122814 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:42468_
   [junit4]   2> 122815 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 122816 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 122824 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 122829 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 122829 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 122830 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores
   [junit4]   2> 122831 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 122831 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1
   [junit4]   2> 122831 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 122833 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 122833 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 122833 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 122833 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:42468_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 122835 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 122835 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42468",
   [junit4]   2>   "node_name":"127.0.0.1:42468_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 122835 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42468",
   [junit4]   2>   "node_name":"127.0.0.1:42468_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 122836 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 122836 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 122838 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 123835 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 123836 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 123836 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 123836 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 123837 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 123837 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1'
   [junit4]   2> 123837 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 123837 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 123839 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 123846 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 123850 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 123867 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 123881 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 123966 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 123967 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 123968 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 123971 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 124002 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 124002 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 124002 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 124004 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1/data/]
   [junit4]   2> 124004 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3a1bdee1
   [junit4]   2> 124029 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1/data
   [junit4]   2> 124031 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1/data/index/
   [junit4]   2> 124031 WARN  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 124032 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1/data/index
   [junit4]   2> 124035 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6776218721792453]
   [junit4]   2> 124039 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@296dff7c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@54b4f7c0),segFN=segments_1,generation=1}
   [junit4]   2> 124039 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 124040 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1/data/
   [junit4]   2> 124041 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 124047 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 124047 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 124047 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 124047 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 124048 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 124048 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 124048 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 124048 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 124048 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 124048 WARN  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 124051 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 124052 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 124053 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 124054 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 124058 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 124058 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 124059 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 124059 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 124060 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 124060 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 124061 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@3dbc12ad
   [junit4]   2> 124064 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@296dff7c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@54b4f7c0),segFN=segments_1,generation=1}
   [junit4]   2> 124064 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 124065 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@769a3d44[collection1] main]
   [junit4]   2> 124065 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 124065 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 124066 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 124066 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 124066 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 124066 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 124066 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 124066 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 124066 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 124067 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 124067 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 124067 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 124067 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 124067 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1529781873933287424
   [junit4]   2> 124069 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1529781873933287424
   [junit4]   2> 124069 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 124070 INFO  (coreLoadExecutor-136-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 124070 INFO  (searcherExecutor-137-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@769a3d44[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 124073 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:42468 collection:control_collection shard:shard1
   [junit4]   2> 124075 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 124080 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95611367015841796-core_node1-n_0000000000
   [junit4]   2> 124080 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 124084 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 124084 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 124084 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 124084 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42468/collection1/
   [junit4]   2> 124084 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 124084 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:42468/collection1/ has no replicas
   [junit4]   2> 124086 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 124091 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95611367015841796-core_node1-n_0000000000
   [junit4]   2> 124098 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42468/collection1/ shard1
   [junit4]   2> 124098 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:42468",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 124201 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 124250 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:42468/collection1/ and leader is http://127.0.0.1:42468/collection1/
   [junit4]   2> 124250 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:42468
   [junit4]   2> 124250 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 124250 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 124250 INFO  (coreZkRegister-130-thread-1-processing-n:127.0.0.1:42468_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:42468_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 124253 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42468",
   [junit4]   2>   "node_name":"127.0.0.1:42468_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 124254 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:42468",
   [junit4]   2>   "node_name":"127.0.0.1:42468_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 124335 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 124337 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 124345 INFO  (zkCallback-71-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1661d333 name:ZooKeeperConnection Watcher:127.0.0.1:49900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 124345 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 124346 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 124346 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 124347 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 124348 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 124356 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 124356 INFO  (zkCallback-71-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 124435 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/cores/collection1
   [junit4]   2> 124436 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001
   [junit4]   2> 124437 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 124438 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@53fea7c9{/,null,AVAILABLE}
   [junit4]   2> 124439 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3deed4e1{HTTP/1.1,[http/1.1]}{127.0.0.1:56275}
   [junit4]   2> 124439 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.e.j.s.Server Started @127584ms
   [junit4]   2> 124439 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=56275, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/cores}
   [junit4]   2> 124440 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 124440 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001'
   [junit4]   2> 124440 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 124440 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 124440 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 124441 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 124449 INFO  (zkCallback-72-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@53e0d6b name:ZooKeeperConnection Watcher:127.0.0.1:49900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 124449 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 124449 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 124452 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 124453 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/solr.xml
   [junit4]   2> 124462 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/cores
   [junit4]   2> 124462 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CoreContainer New CoreContainer 82512329
   [junit4]   2> 124462 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001]
   [junit4]   2> 124462 WARN  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/lib
   [junit4]   2> 124462 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 124464 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 124464 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 124464 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 124464 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49900/solr
   [junit4]   2> 124464 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 124465 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 124473 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 124477 INFO  (zkCallback-75-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3549b35b name:ZooKeeperConnection Watcher:127.0.0.1:49900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 124478 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 124478 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 124486 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 124496 INFO  (zkCallback-76-thread-1-processing-n:127.0.0.1:56275_) [n:127.0.0.1:56275_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b26bd92 name:ZooKeeperConnection Watcher:127.0.0.1:49900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 124496 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 124506 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 124507 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 124509 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 124509 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95611367015841800-127.0.0.1:56275_-n_0000000001
   [junit4]   2> 124510 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95611367015841796-127.0.0.1:42468_-n_0000000000 to know if I could be the leader
   [junit4]   2> 124510 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.ZkController Publish node=127.0.0.1:56275_ as DOWN
   [junit4]   2> 124512 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:56275_"} current state version: 3
   [junit4]   2> 124512 INFO  (OverseerStateUpdate-95611367015841796-127.0.0.1:42468_-n_0000000000) [n:127.0.0.1:42468_    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:56275_
   [junit4]   2> 124614 INFO  (zkCallback-76-thread-1-processing-n:127.0.0.1:56275_) [n:127.0.0.1:56275_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 124614 INFO  (zkCallback-71-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 124614 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 125512 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56275_
   [junit4]   2> 125513 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56275_
   [junit4]   2> 125514 INFO  (zkCallback-76-thread-1-processing-n:127.0.0.1:56275_) [n:127.0.0.1:56275_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 125514 INFO  (zkCallback-71-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 125514 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 125515 INFO  (zkCallback-71-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 125515 INFO  (zkCallback-76-thread-1-processing-n:127.0.0.1:56275_) [n:127.0.0.1:56275_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 125519 INFO  (zkCallback-69-thread-1-processing-n:127.0.0.1:42468_) [n:127.0.0.1:42468_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 125523 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 125523 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 125524 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/cores
   [junit4]   2> 125525 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 125525 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_AB4EF3E1B06AF31B-001/shard-1-001/cores/collection1
   [junit4]   2> 125525 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 125531 INFO  (TEST-FullSolrCloudDistribCmdsTest.test-seed#[AB4EF3E1B06AF31B]) [n:127.0.0.1:56275_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-cor

[...truncated too long message...]

2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 8693644 ERROR (zkCallback-4073-thread-7-processing-n:127.0.0.1:38140_-EventThread) [n:127.0.0.1:38140_    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$7/125936944@6887dc3f rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7566214e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 521]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 8693644 ERROR (zkCallback-4073-thread-7-processing-n:127.0.0.1:38140_-EventThread) [n:127.0.0.1:38140_    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$7/125936944@15f4843a rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7566214e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 521]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> NOTE: test params are: codec=Lucene60, sim=ClassicSimilarity, locale=th-TH-u-nu-thai-x-lvariant-TH, timezone=Asia/Novokuznetsk
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=25376264,total=423100416
   [junit4]   2> NOTE: All tests run in this JVM: [TlogReplayBufferedWhileIndexingTest, CollectionTooManyReplicasTest, BlockCacheTest, BlockJoinFacetDistribTest, DistributedFacetPivotSmallTest, CustomCollectionTest, DeleteReplicaTest, SegmentsInfoRequestHandlerTest, BitVectorTest, DistributedFacetPivotLargeTest, XsltUpdateRequestHandlerTest, SOLR749Test, PolyFieldTest, TestReplicationHandler, TestComplexPhraseQParserPlugin, AnalysisErrorHandlingTest, BadCopyFieldTest, TestBinaryField, TestClassicSimilarityFactory, TestMiniSolrCloudClusterSSL, TestTestInjection, TestLuceneMatchVersion, TestReplicaProperties, TestRangeQuery, RestartWhileUpdatingTest, SynonymTokenizerTest, TestShortCircuitedRequests, TestMaxScoreQueryParser, MergeStrategyTest, TestFoldingMultitermQuery, OutputWriterTest, OverseerRolesTest, TestConfig, BasicDistributedZkTest, TestSortingResponseWriter, DefaultValueUpdateProcessorTest, TestFastOutputStream, TestConfigSetImmutable, GraphQueryTest, TestRestManager, RAMDirectoryFactoryTest, TestLazyCores, TestDocSet, TestSerializedLuceneMatchVersion, DistributedSpellCheckComponentTest, HdfsSyncSliceTest, CacheHeaderTest, ResourceLoaderTest, CachingDirectoryFactoryTest, AnalysisAfterCoreReloadTest, TestCryptoKeys, TestTrackingShardHandlerFactory, IgnoreCommitOptimizeUpdateProcessorFactoryTest, RecoveryAfterSoftCommitTest, SolrRequestParserTest, TestStandardQParsers, DocumentAnalysisRequestHandlerTest, JsonLoaderTest, EchoParamsTest, TestCloudInspectUtil, TestFilteredDocIdSet, ConnectionReuseTest, PKIAuthenticationIntegrationTest, TestRandomDVFaceting, SharedFSAutoReplicaFailoverUtilsTest, TestFileDictionaryLookup, TestRTGBase, DistributedQueueTest, ZkNodePropsTest, DateFieldTest, TestPerFieldSimilarityClassic, ReturnFieldsTest, CurrencyFieldOpenExchangeTest, TestComponentsName, ExternalFileFieldSortTest, TestReloadDeadlock, TestLMDirichletSimilarityFactory, DocValuesMissingTest, AsyncCallRequestStatusResponseTest, TestFieldTypeCollectionResource, TestCrossCoreJoin, TestOrdValues, TestPhraseSuggestions, ResponseLogComponentTest, PrimUtilsTest, SpatialHeatmapFacetsTest, HdfsBasicDistributedZk2Test, TestSolrXml, TestShardHandlerFactory, PeerSyncTest, LeaderElectionIntegrationTest, IndexSchemaRuntimeFieldTest, TestSolrConfigHandlerConcurrent, OverseerTest, LeaderElectionTest, ZkCLITest, ShardRoutingCustomTest, AutoCommitTest, TestDistributedGrouping, TestFaceting, TestRecovery, TestHashPartitioner, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestJoin, TestStressVersions, TestSolr4Spatial, SolrCoreTest, SolrCmdDistributorTest, QueryElevationComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, TestFiltering, TestFunctionQuery, TestBadConfig, TestIndexSearcher, HighlighterTest, SoftAutoCommitTest, DistributedQueryElevationComponentTest, SimplePostToolTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, CoreAdminHandlerTest, DocValuesTest, TestStressLucene, TestTrie, SpatialFilterTest, SuggesterWFSTTest, TestCSVLoader, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, TestUpdate, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, TestRemoteStreaming, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, TestOmitPositions, FileBasedSpellCheckerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestIndexingPerformance, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, TestJmxIntegration, JSONWriterTest, TestCSVResponseWriter, MBeansHandlerTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, PingRequestHandlerTest, TestBinaryResponseWriter, HighlighterConfigTest, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, BadComponentTest, TestStressRecovery, TestMergePolicyConfig, TestElisionMultitermQuery, SpellPossibilityIteratorTest, TestCodecSupport, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TimeZoneUtilsTest, URLClassifyProcessorTest, DateMathParserTest, TestSuggestSpellingConverter, TestUtils, FileUtilsTest, CursorPagingTest, SolrTestCaseJ4Test, TestDistributedMissingSort, TestSimpleTrackingShardHandler, CdcrReplicationDistributedZkTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [582/582 (4!)] on J0 in 4723.81s, 1 test, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/temp/junit4-J0-20160325_134555_607.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/heapdumps/java_pid32126.hprof ...
   [junit4] Heap dump file created [611464063 bytes in 4.618 secs]
   [junit4] <<< JVM J0: EOF ----

[...truncated 13 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:529: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1014: There were test failures: 582 suites (10 ignored), 2331 tests, 3 errors, 1 failure, 32 ignored (16 assumptions) [seed: AB4EF3E1B06AF31B]

Total time: 275 minutes 39 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message