lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 757 - Still Failing
Date Thu, 06 Aug 2015 09:28:47 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/757/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest.test

Error Message:
commitWithin did not work on node: http://127.0.0.1:52502/sd/q/collection1 expected:<68> but was:<67>

Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:52502/sd/q/collection1 expected:<68> but was:<67>
	at __randomizedtesting.SeedInfo.seed([E854160F8BD5DF74:600029D52529B28C]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:332)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=3856, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3856, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45357/_l/q: Could not find collection : awholynewstresscollection_collection5_0
	at __randomizedtesting.SeedInfo.seed([E854160F8BD5DF74]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:894)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=80870, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=80870, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:50896/b/y: Could not find collection : awholynewstresscollection_collection1_0
	at __randomizedtesting.SeedInfo.seed([E854160F8BD5DF74]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:894)




Build Log:
[...truncated 10324 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsBasicDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/init-core-data-001
   [junit4]   2> 319104 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /sd/q
   [junit4]   2> 319817 WARN  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 320578 WARN  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 320942 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 320953 WARN  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 321041 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 321096 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_44391_hdfs____.o6768b/webapp
   [junit4]   2> 321288 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 321988 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44391
   [junit4]   2> 324305 WARN  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 324312 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 324325 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_44264_datanode____uop8ev/webapp
   [junit4]   2> 324433 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 324938 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44264
   [junit4]   2> 325055 WARN  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 325057 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 325070 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37856_datanode____.au5kf8/webapp
   [junit4]   2> 325179 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 325605 INFO  (SUITE-HdfsBasicDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37856
   [junit4]   2> 325828 INFO  (IPC Server handler 8 on 46549) [    ] BlockStateChange BLOCK* processReport: from storage DS-2c1f8b7e-4f05-4764-9150-e55a80410d97 node DatanodeRegistration(127.0.0.1, datanodeUuid=bd837b82-db1c-4b42-b7eb-61e983c3ddc2, infoPort=37856, ipcPort=39507, storageInfo=lv=-56;cid=testClusterID;nsid=830501141;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 325828 INFO  (IPC Server handler 5 on 46549) [    ] BlockStateChange BLOCK* processReport: from storage DS-01939ccc-397e-4d65-afa5-f26c025c31df node DatanodeRegistration(127.0.0.1, datanodeUuid=1d8a0b1f-3d79-4228-9d80-90f0478eef89, infoPort=44264, ipcPort=42901, storageInfo=lv=-56;cid=testClusterID;nsid=830501141;c=0), blocks: 0, hasStaleStorages: true, processing time: 4 msecs
   [junit4]   2> 325835 INFO  (IPC Server handler 8 on 46549) [    ] BlockStateChange BLOCK* processReport: from storage DS-60e83d22-36b3-459b-ab66-de9b9288643b node DatanodeRegistration(127.0.0.1, datanodeUuid=bd837b82-db1c-4b42-b7eb-61e983c3ddc2, infoPort=37856, ipcPort=39507, storageInfo=lv=-56;cid=testClusterID;nsid=830501141;c=0), blocks: 0, hasStaleStorages: false, processing time: 1 msecs
   [junit4]   2> 325845 INFO  (IPC Server handler 5 on 46549) [    ] BlockStateChange BLOCK* processReport: from storage DS-86d53821-dd4a-441c-b5ad-dbe0c5365ab5 node DatanodeRegistration(127.0.0.1, datanodeUuid=1d8a0b1f-3d79-4228-9d80-90f0478eef89, infoPort=44264, ipcPort=42901, storageInfo=lv=-56;cid=testClusterID;nsid=830501141;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 326482 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 326482 INFO  (Thread-1568) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 326483 INFO  (Thread-1568) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 326582 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.ZkTestServer start zk server on port:40888
   [junit4]   2> 326583 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 326583 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 326589 INFO  (zkCallback-430-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5cccec8a name:ZooKeeperConnection Watcher:127.0.0.1:40888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 326590 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 326590 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 326590 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 326593 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 326601 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 326606 INFO  (zkCallback-431-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@378c0f76 name:ZooKeeperConnection Watcher:127.0.0.1:40888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 326606 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 326606 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 326606 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 326610 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 326612 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 326613 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 326614 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 326614 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 326617 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 326617 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 326619 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 326619 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 326620 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 326620 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 326622 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 326623 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 326624 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 326624 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 326626 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 326626 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 326628 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 326628 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 326630 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 326630 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 326632 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 326632 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 326634 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 326634 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 326951 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores/collection1
   [junit4]   2> 326953 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 326955 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@180afb13{/sd/q,null,AVAILABLE}
   [junit4]   2> 326955 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1e7dee93{HTTP/1.1}{127.0.0.1:45020}
   [junit4]   2> 326956 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.Server Started @330320ms
   [junit4]   2> 326956 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:46549/hdfs__localhost_46549__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001_tempDir-002_control_data, hostContext=/sd/q, hostPort=45020, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores}
   [junit4]   2> 326956 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 326956 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/'
   [junit4]   2> 326972 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 326973 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 326975 INFO  (zkCallback-432-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18aeaaf7 name:ZooKeeperConnection Watcher:127.0.0.1:40888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 326975 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 326975 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 326977 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 326977 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/solr.xml
   [junit4]   2> 326983 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores
   [junit4]   2> 326983 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoreContainer New CoreContainer 1332066993
   [junit4]   2> 326983 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/]
   [junit4]   2> 326983 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/lib
   [junit4]   2> 326984 WARN  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/lib).
   [junit4]   2> 326991 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 326993 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 326993 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 326993 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 326993 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40888/solr
   [junit4]   2> 326994 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 326994 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 326995 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 326996 INFO  (zkCallback-434-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b7cc039 name:ZooKeeperConnection Watcher:127.0.0.1:40888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 326997 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 326997 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 326999 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 327000 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7450c05 name:ZooKeeperConnection Watcher:127.0.0.1:40888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 327000 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 327001 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 327003 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 327004 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 327006 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 327007 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 327009 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 327010 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 327011 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 327012 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45020_sd%2Fq
   [junit4]   2> 327012 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:45020_sd%2Fq
   [junit4]   2> 327014 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 327015 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 327016 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 327016 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000
   [junit4]   2> 327017 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45020_sd%2Fq
   [junit4]   2> 327017 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 327018 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.Overseer Overseer (id=94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) starting
   [junit4]   2> 327019 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 327024 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 327024 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 327025 INFO  (OverseerCollectionProcessor-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
   [junit4]   2> 327025 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 327050 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 327051 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 327051 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores
   [junit4]   2> 327052 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 327053 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores/collection1/
   [junit4]   2> 327053 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 327054 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 327054 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 327054 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 327054 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 327057 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 327057 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 327058 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45020/sd/q",
   [junit4]   2>   "node_name":"127.0.0.1:45020_sd%2Fq",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 327059 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45020/sd/q",
   [junit4]   2>   "node_name":"127.0.0.1:45020_sd%2Fq",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 327059 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 327059 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 327060 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 327061 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
   [junit4]   2> 328057 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 328058 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 328059 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 328059 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 328060 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 328060 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores/collection1/'
   [junit4]   2> 328079 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 328085 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 328089 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 328097 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 328099 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 328106 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 328221 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 328228 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 328229 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 328245 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 328248 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 328250 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 328251 WARN  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 328251 WARN  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 328251 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 328252 WARN  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 328252 WARN  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 328254 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 328254 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 328254 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 328270 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:46549/solr_hdfs_home
   [junit4]   2> 328271 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 328271 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 328271 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@779f286d
   [junit4]   2> 328272 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 328334 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
   [junit4]   2> 328335 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 328340 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 328369 WARN  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:46549/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 328370 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 328380 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 328380 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 328381 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new global HDFS BlockCache
   [junit4]   2> 330297 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 330297 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
   [junit4]   2> 330298 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 330298 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=2.1064453125, floorSegmentMB=0.9326171875, forceMergeDeletesPctAllowed=28.34671725402622, segmentsPerTier=11.0, maxCFSSegmentSizeMB=1.79296875, noCFSRatio=0.0
   [junit4]   2> 330706 INFO  (IPC Server handler 0 on 46549) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:37134 is added to blk_1073741825_1001{blockUCState=COMMITTED, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-60e83d22-36b3-459b-ab66-de9b9288643b:NORMAL:127.0.0.1:42345|RBW], ReplicaUnderConstruction[[DISK]DS-86d53821-dd4a-441c-b5ad-dbe0c5365ab5:NORMAL:127.0.0.1:37134|RBW]]} size 71
   [junit4]   2> 330721 INFO  (IPC Server handler 1 on 46549) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42345 is added to blk_1073741825_1001 size 71
   [junit4]   2> 331117 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b791a717 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@98c96a2); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 331118 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 331132 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 331133 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 331139 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 331140 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 331140 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 331140 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 331140 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 331140 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 331141 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 331142 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 331144 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 331145 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 331145 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 331149 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 331149 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 331149 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:46549/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 331171 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 331171 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 331213 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 331216 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 331236 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=44.3212890625, floorSegmentMB=0.931640625, forceMergeDeletesPctAllowed=18.67403629752964, segmentsPerTier=20.0, maxCFSSegmentSizeMB=2.154296875, noCFSRatio=0.0
   [junit4]   2> 331423 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@b791a717 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@98c96a2); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 331424 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 331424 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@80d7c27[collection1] main
   [junit4]   2> 331424 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 331437 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 331438 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 331439 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 331439 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 331439 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 331440 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 331440 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 331440 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 331440 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 331450 INFO  (searcherExecutor-1270-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@80d7c27[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 331458 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 331459 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 331459 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 331459 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1508743201037484032
   [junit4]   2> 331459 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0 ms to seed version buckets with highest version 1508743201037484032
   [junit4]   2> 331459 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 331460 INFO  (coreLoadExecutor-1269-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 331483 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:45020/sd/q collection:control_collection shard:shard1
   [junit4]   2> 331484 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 331499 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94296449738866692-core_node1-n_0000000000
   [junit4]   2> 331500 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 331501 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 331502 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 331503 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331505 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
   [junit4]   2> 331506 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 331506 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 331506 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45020/sd/q/collection1/
   [junit4]   2> 331506 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 331506 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:45020/sd/q/collection1/ has no replicas
   [junit4]   2> 331506 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45020/sd/q/collection1/ shard1
   [junit4]   2> 331507 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 331555 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 331556 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:45020/sd/q",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 331557 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 331577 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 331586 INFO  (zkCallback-437-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76e98ebc name:ZooKeeperConnection Watcher:127.0.0.1:40888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 331586 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 331586 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 331586 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 331588 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 331661 INFO  (zkCallback-437-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331662 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331664 INFO  (zkCallback-437-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
   [junit4]   2> 331665 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
   [junit4]   2> 331707 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:45020/sd/q/collection1/ and leader is http://127.0.0.1:45020/sd/q/collection1/
   [junit4]   2> 331707 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45020/sd/q
   [junit4]   2> 331707 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 331707 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 331708 INFO  (coreZkRegister-1263-thread-1-processing-n:127.0.0.1:45020_sd%2Fq x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:45020_sd%2Fq c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 331709 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 331709 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45020/sd/q",
   [junit4]   2>   "node_name":"127.0.0.1:45020_sd%2Fq",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 331710 INFO  (OverseerStateUpdate-94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:45020/sd/q",
   [junit4]   2>   "node_name":"127.0.0.1:45020_sd%2Fq",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 331818 INFO  (zkCallback-437-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331818 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 331820 INFO  (zkCallback-437-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
   [junit4]   2> 331822 INFO  (zkCallback-435-thread-1-processing-n:127.0.0.1:45020_sd%2Fq) [n:127.0.0.1:45020_sd%2Fq    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
   [junit4]   2> 332146 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/cores/collection1
   [junit4]   2> 332148 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001
   [junit4]   2> 332150 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 332153 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35779c58{/sd/q,null,AVAILABLE}
   [junit4]   2> 332154 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.ServerConnector Started ServerConnector@2ecb4371{HTTP/1.1}{127.0.0.1:52502}
   [junit4]   2> 332154 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.e.j.s.Server Started @335518ms
   [junit4]   2> 332154 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:46549/hdfs__localhost_46549__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/sd/q, hostPort=52502, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/cores}
   [junit4]   2> 332154 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 332155 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/'
   [junit4]   2> 332192 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 332208 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 332220 INFO  (zkCallback-438-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@35dd0133 name:ZooKeeperConnection Watcher:127.0.0.1:40888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 332220 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 332221 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 332233 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 332233 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/solr.xml
   [junit4]   2> 332239 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/cores
   [junit4]   2> 332239 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoreContainer New CoreContainer 1812137232
   [junit4]   2> 332239 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/]
   [junit4]   2> 332239 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/lib
   [junit4]   2> 332239 WARN  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/lib).
   [junit4]   2> 332255 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 332257 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 332257 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 332257 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 332257 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40888/solr
   [junit4]   2> 332258 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 332258 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 332272 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 332285 INFO  (zkCallback-440-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@130e9 name:ZooKeeperConnection Watcher:127.0.0.1:40888 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 332286 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 332286 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 332310 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 332321 INFO  (zkCallback-441-thread-1-processing-n:127.0.0.1:52502_sd%2Fq) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f09584c name:ZooKeeperConnection Watcher:127.0.0.1:40888/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 332321 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 332325 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 333328 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52502_sd%2Fq
   [junit4]   2> 333329 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:52502_sd%2Fq
   [junit4]   2> 333331 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 333331 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94296449738866696-127.0.0.1:52502_sd%2Fq-n_0000000001
   [junit4]   2> 333332 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94296449738866692-127.0.0.1:45020_sd%2Fq-n_0000000000 to know if I could be the leader
   [junit4]   2> 333344 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 333344 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 333345 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/cores
   [junit4]   2> 333347 INFO  (TEST-HdfsBasicDistributedZkTest.test-seed#[E854160F8BD5DF74]) [n:127.0.0.1:52502_sd%2Fq    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsBasicDistributedZkTest_E854160F8BD5DF74-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 333347 INFO  (

[...truncated too long message...]

1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 3920900 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[E854160F8BD5DF74]-worker) [n:127.0.0.1:50896_b%2Fy c:addReplicaColl s:shard1 r:core_node7 x:propertyDotName] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Aug 06, 2015 5:27:11 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=tr, timezone=US/Hawaii
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=189860416,total=535298048
   [junit4]   2> NOTE: All tests run in this JVM: [TestConfig, CSVRequestHandlerTest, TestJmxMonitoredMap, SolrCoreTest, TestDynamicFieldCollectionResource, HighlighterConfigTest, TestPostingsSolrHighlighter, TestHashQParserPlugin, TestScoreJoinQPNoScore, TestOrdValues, ReplicationFactorTest, TestDefaultSearchFieldResource, RecoveryAfterSoftCommitTest, QueryElevationComponentTest, AddBlockUpdateTest, DateFieldTest, PeerSyncTest, TestRealTimeGet, TestQuerySenderListener, DistributedSpellCheckComponentTest, DistributedQueryComponentCustomSortTest, DistributedFacetPivotLongTailTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, CoreAdminCreateDiscoverTest, LeaderInitiatedRecoveryOnCommitTest, TestIndexingPerformance, SignatureUpdateProcessorFactoryTest, TestLRUStatsCache, TestMiniSolrCloudCluster, DistributedSuggestComponentTest, RuleEngineTest, TestRemoveLastDynamicCopyField, ZkNodePropsTest, TestFaceting, TestArbitraryIndexDir, TestRemoteStreaming, OverriddenZkACLAndCredentialsProvidersTest, TestNamedUpdateProcessors, HdfsBasicDistributedZkTest, TestExactStatsCache, MergeStrategyTest, RequestLoggingTest, SchemaVersionSpecificBehaviorTest, PingRequestHandlerTest, TestRawResponseWriter, TestSolr4Spatial2, UUIDFieldTest, CurrencyFieldXmlFileTest, SparseHLLTest, ClusterStateTest, TestSolrConfigHandlerCloud, TestAuthorizationFramework, TestCollationFieldDocValues, TestDocumentBuilder, TestTolerantSearch, SuggesterFSTTest, HdfsDirectoryTest, TestAnalyzeInfixSuggestions, SimpleMLTQParserTest, HdfsBasicDistributedZk2Test, TestReplicationHandler, TestManagedResource, TestMacros, UniqFieldsUpdateProcessorFactoryTest, TermsComponentTest, TestMergePolicyConfig, TestSolrIndexConfig, ChaosMonkeyNothingIsSafeTest, TestBadConfig, TestFileDictionaryLookup, CloudMLTQParserTest, DateMathParserTest, DistributedDebugComponentTest, FastVectorHighlighterTest, TestBinaryField, TestReplicaProperties, TestCollapseQParserPlugin, DeleteInactiveReplicaTest, CoreMergeIndexesAdminHandlerTest, FullHLLTest, TestHdfsUpdateLog, TestUniqueKeyFieldResource, TestCryptoKeys, SimplePostToolTest, TestMiniSolrCloudClusterSSL, TestCodecSupport, URLClassifyProcessorTest, DistributedIntervalFacetingTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, CloudExitableDirectoryReaderTest, CollectionReloadTest, CollectionTooManyReplicasTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, MultiThreadedOCPTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerStatusTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverTest, TestCloudPivotFacet, TestCollectionAPI, TestRequestStatusCollectionAPI, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [532/534] on J0 in 604.62s, 1 test, 1 error <<< FAILURES!

[...truncated 19 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:723: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:660: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1429: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:984: There were test failures: 534 suites, 2111 tests, 2 errors, 1 failure, 26 ignored (14 assumptions)

Total time: 253 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message