lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 776 - Still Failing
Date Wed, 26 Aug 2015 11:39:20 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/776/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.TestRebalanceLeaders.test

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:57241, http://127.0.0.1:56384, http://127.0.0.1:40438, http://127.0.0.1:50878, http://127.0.0.1:41922]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:57241, http://127.0.0.1:56384, http://127.0.0.1:40438, http://127.0.0.1:50878, http://127.0.0.1:41922]
	at __randomizedtesting.SeedInfo.seed([1A55CE4403CDBAD5:9201F19EAD31D72D]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.TestRebalanceLeaders.issueCommands(TestRebalanceLeaders.java:281)
	at org.apache.solr.cloud.TestRebalanceLeaders.rebalanceLeaderTest(TestRebalanceLeaders.java:109)
	at org.apache.solr.cloud.TestRebalanceLeaders.test(TestRebalanceLeaders.java:75)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:56384: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 </title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /admin/collections. Reason:
<pre>    {trace=java.lang.AssertionError
	at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:36)
	at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:64)
	at org.apache.solr.common.util.Utils.fromJSON(Utils.java:97)
	at org.apache.solr.common.cloud.ZkNodeProps.load(ZkNodeProps.java:81)
	at org.apache.solr.cloud.OverseerCollectionQueue.containsTaskWithRequestId(OverseerCollectionQueue.java:66)
	at org.apache.solr.handler.admin.CollectionsHandler.overseerCollectionQueueContains(CollectionsHandler.java:256)
	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:211)
	at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:191)
	at org.apache.solr.handler.admin.RebalanceLeaders.rejoinElection(RebalanceLeaders.java:269)
	at org.apache.solr.handler.admin.RebalanceLeaders.insurePreferredIsLeader(RebalanceLeaders.java:184)
	at org.apache.solr.handler.admin.RebalanceLeaders.execute(RebalanceLeaders.java:91)
	at org.apache.solr.handler.admin.CollectionsHandler$CollectionOperation$23.call(CollectionsHandler.java:685)
	at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:166)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:673)
	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:441)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:210)
	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
	at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
	at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
	at org.eclipse.jetty.server.Server.handle(Server.java:499)
	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
	at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
	at java.lang.Thread.run(Thread.java:745)
,code=500}</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:528)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:341)
	... 48 more


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:48599: create the collection time out:180s

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:48599: create the collection time out:180s
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:302)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:450)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=75488, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=75488, name=collection0, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47300/_/t: Could not find collection : awholynewstresscollection_collection0_0
	at __randomizedtesting.SeedInfo.seed([1A55CE4403CDBAD5]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10362 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestRebalanceLeaders
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/init-core-data-001
   [junit4]   2> 1908749 INFO  (SUITE-TestRebalanceLeaders-seed#[1A55CE4403CDBAD5]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1908749 INFO  (SUITE-TestRebalanceLeaders-seed#[1A55CE4403CDBAD5]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1908753 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1908765 INFO  (Thread-54819) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1908765 INFO  (Thread-54819) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1908865 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.ZkTestServer start zk server on port:53987
   [junit4]   2> 1908865 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1908889 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1908892 INFO  (zkCallback-2045-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@22593b01 name:ZooKeeperConnection Watcher:127.0.0.1:53987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1908892 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1908892 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1908893 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1908895 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1908896 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1908897 INFO  (zkCallback-2046-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7a271e66 name:ZooKeeperConnection Watcher:127.0.0.1:53987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1908897 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1908897 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1908897 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1908900 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1908901 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1908902 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1908903 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1908904 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1908906 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1908906 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1908907 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1908908 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1908909 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1908909 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1908910 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1908910 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1908912 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1908912 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1908913 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1908913 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1908914 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1908915 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1908916 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1908916 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1908917 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1908917 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1908919 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1908919 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1909405 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1
   [junit4]   2> 1909407 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1909410 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@bce5da3{/,null,AVAILABLE}
   [junit4]   2> 1909412 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.ServerConnector Started ServerConnector@71f23675{HTTP/1.1}{127.0.0.1:57241}
   [junit4]   2> 1909412 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.Server Started @1912614ms
   [junit4]   2> 1909412 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/tempDir-001/control/data, hostContext=/, hostPort=57241, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores}
   [junit4]   2> 1909412 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1909412 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/'
   [junit4]   2> 1909433 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1909434 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1909437 INFO  (zkCallback-2047-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6e1903ac name:ZooKeeperConnection Watcher:127.0.0.1:53987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1909437 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1909437 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1909438 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1909438 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/solr.xml
   [junit4]   2> 1909443 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores
   [junit4]   2> 1909444 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoreContainer New CoreContainer 828371231
   [junit4]   2> 1909444 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/]
   [junit4]   2> 1909444 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/lib
   [junit4]   2> 1909444 WARN  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/lib).
   [junit4]   2> 1909452 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1909454 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1909454 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1909454 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1909454 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53987/solr
   [junit4]   2> 1909454 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1909455 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1909465 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1909467 INFO  (zkCallback-2049-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@21c472de name:ZooKeeperConnection Watcher:127.0.0.1:53987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1909469 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1909470 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1909473 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1909483 INFO  (zkCallback-2050-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@589db0b0 name:ZooKeeperConnection Watcher:127.0.0.1:53987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1909483 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1909484 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1909486 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1909487 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1909489 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1909491 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1909493 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1909494 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1909495 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1909496 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1909498 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57241_
   [junit4]   2> 1909498 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:57241_
   [junit4]   2> 1909499 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1909502 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1909503 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1909503 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94410230406053892-127.0.0.1:57241_-n_0000000000
   [junit4]   2> 1909504 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:57241_
   [junit4]   2> 1909504 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1909505 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer Overseer (id=94410230406053892-127.0.0.1:57241_-n_0000000000) starting
   [junit4]   2> 1909507 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1909512 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1909513 INFO  (OverseerCollectionProcessor-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.OverseerProcessor Process current queue of overseer operations
   [junit4]   2> 1909513 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1909514 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1909529 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1909529 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1909530 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores
   [junit4]   2> 1909531 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1909531 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/
   [junit4]   2> 1909531 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1909533 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1909533 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1909533 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 1909533 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:57241_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1909534 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57241",
   [junit4]   2>   "node_name":"127.0.0.1:57241_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1909534 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1909535 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57241",
   [junit4]   2>   "node_name":"127.0.0.1:57241_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1909535 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1909536 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1909537 INFO  (zkCallback-2050-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1910535 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1910535 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1910536 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1910536 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1910536 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1910536 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/'
   [junit4]   2> 1910564 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1910569 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1910572 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1910625 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1910626 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1910630 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1910815 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1910816 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1910817 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1910820 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1910835 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 1910835 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1910835 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1910835 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1910835 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2c7a1520
   [junit4]   2> 1910836 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/data
   [junit4]   2> 1910836 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1910836 WARN  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1910837 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/data/index
   [junit4]   2> 1910838 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=42, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.6279296875, noCFSRatio=1.0]
   [junit4]   2> 1910838 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@12296ed2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10b6e221),segFN=segments_1,generation=1}
   [junit4]   2> 1910838 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1910842 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1910842 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1910842 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1910842 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1910843 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1910843 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1910843 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1910843 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1910843 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1910845 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1910846 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1910847 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1910848 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1910849 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/data/
   [junit4]   2> 1910849 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1910868 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1910868 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1910869 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1910869 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1910870 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1910870 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1910871 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=816110982, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1910871 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@12296ed2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10b6e221),segFN=segments_1,generation=1}
   [junit4]   2> 1910872 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1910872 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7ed9deba[collection1] main
   [junit4]   2> 1910872 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1910873 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1910873 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1910874 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1910874 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1910874 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1910875 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1910875 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1910875 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1910875 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1910875 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1910876 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1910876 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1910876 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1510563688693628928
   [junit4]   2> 1910877 INFO  (searcherExecutor-2812-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7ed9deba[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1910878 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1510563688693628928
   [junit4]   2> 1910879 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1910879 INFO  (coreLoadExecutor-2811-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1910880 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:57241 collection:control_collection shard:shard1
   [junit4]   2> 1910881 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1910884 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94410230406053892-core_node1-n_0000000000
   [junit4]   2> 1910884 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1910886 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1910887 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1910886 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1910887 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:57241/collection1/
   [junit4]   2> 1910888 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1910888 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:57241/collection1/ has no replicas
   [junit4]   2> 1910888 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:57241/collection1/ shard1
   [junit4]   2> 1910889 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1910892 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:57241",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1910994 INFO  (zkCallback-2050-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1911035 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1911043 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:57241/collection1/ and leader is http://127.0.0.1:57241/collection1/
   [junit4]   2> 1911043 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57241
   [junit4]   2> 1911043 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1911044 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1911044 INFO  (coreZkRegister-2805-thread-1-processing-n:127.0.0.1:57241_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:57241_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1911045 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57241",
   [junit4]   2>   "node_name":"127.0.0.1:57241_",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1911046 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.o.ReplicaMutator Update state numShards=4 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:57241",
   [junit4]   2>   "node_name":"127.0.0.1:57241_",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1911053 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1911069 INFO  (zkCallback-2052-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@310a06c1 name:ZooKeeperConnection Watcher:127.0.0.1:53987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1911069 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1911069 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1911070 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1911071 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1911192 INFO  (zkCallback-2052-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1911198 INFO  (zkCallback-2050-thread-1-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1911925 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/cores/collection1
   [junit4]   2> 1911926 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001
   [junit4]   2> 1911927 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1911931 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@59d75ad3{/,null,AVAILABLE}
   [junit4]   2> 1911931 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.ServerConnector Started ServerConnector@37aaf6b{HTTP/1.1}{127.0.0.1:56384}
   [junit4]   2> 1911931 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.e.j.s.Server Started @1915134ms
   [junit4]   2> 1911931 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=56384, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/cores}
   [junit4]   2> 1911932 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1911932 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/'
   [junit4]   2> 1911948 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1911949 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1911950 INFO  (zkCallback-2053-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6f1051dd name:ZooKeeperConnection Watcher:127.0.0.1:53987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1911950 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1911951 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1911952 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1911952 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/solr.xml
   [junit4]   2> 1911958 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/cores
   [junit4]   2> 1911958 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoreContainer New CoreContainer 1742237119
   [junit4]   2> 1911958 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/]
   [junit4]   2> 1911958 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/lib
   [junit4]   2> 1911958 WARN  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/lib).
   [junit4]   2> 1911966 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1911967 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1911968 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1911968 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1911968 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53987/solr
   [junit4]   2> 1911968 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1911968 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1911970 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1911989 INFO  (zkCallback-2055-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c6ab8c5 name:ZooKeeperConnection Watcher:127.0.0.1:53987 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1911990 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1911990 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1912009 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912021 INFO  (zkCallback-2056-thread-1-processing-n:127.0.0.1:56384_) [n:127.0.0.1:56384_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@438dcf34 name:ZooKeeperConnection Watcher:127.0.0.1:53987/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912021 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1912024 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1913028 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56384_
   [junit4]   2> 1913029 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56384_
   [junit4]   2> 1913030 INFO  (zkCallback-2050-thread-2-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1913030 INFO  (zkCallback-2056-thread-1-processing-n:127.0.0.1:56384_) [n:127.0.0.1:56384_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1913030 INFO  (zkCallback-2052-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1913031 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1913032 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94410230406053896-127.0.0.1:56384_-n_0000000001
   [junit4]   2> 1913032 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94410230406053892-127.0.0.1:57241_-n_0000000000 to know if I could be the leader
   [junit4]   2> 1913065 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1913065 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1913065 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/cores
   [junit4]   2> 1913066 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1913066 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders_1A55CE4403CDBAD5-001/shard-1-001/cores/collection1/
   [junit4]   2> 1913067 INFO  (TEST-TestRebalanceLeaders.test-seed#[1A55CE4403CDBAD5]) [n:127.0.0.1:56384_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1913069 INFO  (coreLoadExecutor-2822-thread-1-processing-n:127.0.0.1:56384_) [n:127.0.0.1:56384_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1913069 INFO  (coreLoadExecutor-2822-thread-1-processing-n:127.0.0.1:56384_) [n:127.0.0.1:56384_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1913071 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56384",
   [junit4]   2>   "node_name":"127.0.0.1:56384_",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 1913072 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.o.ReplicaMutator Update state numShards=4 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56384",
   [junit4]   2>   "node_name":"127.0.0.1:56384_",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1913072 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1913072 INFO  (OverseerStateUpdate-94410230406053892-127.0.0.1:57241_-n_0000000000) [n:127.0.0.1:57241_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1913073 INFO  (zkCallback-2050-thread-2-processing-n:127.0.0.1:57241_) [n:127.0.0.1:57241_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1913073 INFO  (zkCallback-2052-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1913074 INFO  (zkCallback-2056-t

[...truncated too long message...]

mxCache(MetricsSourceAdapter.java:172)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 4400003 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[1A55CE4403CDBAD5]-worker) [n:127.0.0.1:60263__%2Ft c:addReplicaColl s:shard2 r:core_node1 x:addReplicaColl_shard2_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Aug 26, 2015 7:24:42 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=mk_MK, timezone=Etc/GMT-8
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=275049984,total=534773760
   [junit4]   2> NOTE: All tests run in this JVM: [TestCSVLoader, PreAnalyzedUpdateProcessorTest, TestQuerySenderListener, HdfsLockFactoryTest, URLClassifyProcessorTest, EnumFieldTest, TestSerializedLuceneMatchVersion, TestJettySolrRunner, TestBulkSchemaAPI, TestSweetSpotSimilarityFactory, TestSolr4Spatial, DocExpirationUpdateProcessorFactoryTest, FullHLLTest, IndexSchemaTest, OverriddenZkACLAndCredentialsProvidersTest, TestTolerantSearch, TestDistributedSearch, TestRemoteStreaming, ResponseHeaderTest, TestCrossCoreJoin, TestRandomRequestDistribution, SharedFSAutoReplicaFailoverUtilsTest, DistributedDebugComponentTest, MultiTermTest, TestJoin, DeleteInactiveReplicaTest, TestCustomDocTransformer, HLLSerializationTest, TestBadConfig, BasicZkTest, DateFieldTest, QueryElevationComponentTest, TermsComponentTest, TestConfigReload, TestCloudPivotFacet, SyncSliceTest, ActionThrottleTest, ZkNodePropsTest, TestSolrQueryParserDefaultOperatorResource, TermVectorComponentTest, CdcrReplicationDistributedZkTest, TestSha256AuthenticationProvider, TestArbitraryIndexDir, TestStressLucene, DateMathParserTest, RequestHandlersTest, TestFunctionQuery, PeerSyncTest, TestDynamicLoading, SolrRequestParserTest, ExitableDirectoryReaderTest, HdfsDirectoryFactoryTest, ConnectionManagerTest, TestClassNameShortening, TestHashQParserPlugin, TestDFRSimilarityFactory, TestDistributedStatsComponentCardinality, TestManagedResource, HdfsSyncSliceTest, TestPhraseSuggestions, TestNamedUpdateProcessors, HighlighterMaxOffsetTest, ClusterStateTest, TestSQLHandler, BasicDistributedZkTest, PingRequestHandlerTest, TestRebalanceLeaders, TestBinaryField, SharedFSAutoReplicaFailoverTest, TestFaceting, CSVRequestHandlerTest, HdfsRecoverLeaseTest, CurrencyFieldXmlFileTest, BadCopyFieldTest, TestIndexingPerformance, SuggesterWFSTTest, TestSearcherReuse, TestRandomFaceting, CoreAdminCreateDiscoverTest, SuggesterFSTTest, RecoveryAfterSoftCommitTest, BlockCacheTest, DefaultValueUpdateProcessorTest, RequestLoggingTest, TestDocumentBuilder, TestDistribIDF, OverseerTest, LeaderElectionIntegrationTest, TestReplicationHandler, DeleteReplicaTest, DistributedVersionInfoTest, SSLMigrationTest, TestAuthenticationFramework, TestCryptoKeys, TestMiniSolrCloudClusterSSL, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [476/540] on J0 in 432.08s, 1 test, 1 error <<< FAILURES!

[...truncated 221 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 540 suites, 2136 tests, 3 errors, 26 ignored (14 assumptions)

Total time: 209 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message