lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 729 - Still Failing
Date Thu, 02 Jul 2015 06:33:36 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/729/

2 tests failed.
REGRESSION:  org.apache.solr.search.TestSearcherReuse.test

Error Message:
expected same:<Searcher@5fa7335b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C2) Uninverting(_1(6.0.0):C1) Uninverting(_2(6.0.0):C1)))}> was not:<Searcher@3b897018[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C2) Uninverting(_1(6.0.0):C1) Uninverting(_2(6.0.0):C1)))}>

Stack Trace:
java.lang.AssertionError: expected same:<Searcher@5fa7335b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C2) Uninverting(_1(6.0.0):C1) Uninverting(_2(6.0.0):C1)))}> was not:<Searcher@3b897018[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C2) Uninverting(_1(6.0.0):C1) Uninverting(_2(6.0.0):C1)))}>
	at __randomizedtesting.SeedInfo.seed([390C9E12426711EC:B158A1C8EC9B7C14]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotSame(Assert.java:641)
	at org.junit.Assert.assertSame(Assert.java:580)
	at org.junit.Assert.assertSame(Assert.java:593)
	at org.apache.solr.search.TestSearcherReuse.assertSearcherHasNotChanged(TestSearcherReuse.java:247)
	at org.apache.solr.search.TestSearcherReuse.test(TestSearcherReuse.java:117)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=8972, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=8972, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:54256: Could not find collection : awholynewstresscollection_collection1_0
	at __randomizedtesting.SeedInfo.seed([390C9E12426711EC]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:894)




Build Log:
[...truncated 10478 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/init-core-data-001
   [junit4]   2> 1234591 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1234591 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1234662 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1234680 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1234711 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1234753 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_33653_hdfs____.fbxzz6/webapp
   [junit4]   2> 1234891 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1235768 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33653
   [junit4]   2> 1235978 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1235980 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1235997 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_50159_datanode____.p0u1a7/webapp
   [junit4]   2> 1236122 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1236896 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:50159
   [junit4]   2> 1236992 WARN  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1236994 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1237009 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_56876_datanode____pn9g3h/webapp
   [junit4]   2> 1237061 INFO  (IPC Server handler 3 on 33281) [    ] BlockStateChange BLOCK* processReport: from storage DS-bcfae989-3d43-47bd-aa2e-21050c2985c9 node DatanodeRegistration(127.0.0.1, datanodeUuid=f9f36223-6ed7-414f-8b34-f3a08ec851a5, infoPort=50159, ipcPort=47137, storageInfo=lv=-56;cid=testClusterID;nsid=183200476;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 1237062 INFO  (IPC Server handler 3 on 33281) [    ] BlockStateChange BLOCK* processReport: from storage DS-e4e19f0d-5a9d-4c36-bd02-6959c8819aea node DatanodeRegistration(127.0.0.1, datanodeUuid=f9f36223-6ed7-414f-8b34-f3a08ec851a5, infoPort=50159, ipcPort=47137, storageInfo=lv=-56;cid=testClusterID;nsid=183200476;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 1237143 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1237972 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[390C9E12426711EC]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56876
   [junit4]   2> 1238089 INFO  (IPC Server handler 8 on 33281) [    ] BlockStateChange BLOCK* processReport: from storage DS-8397aa60-b007-44b7-9aa2-217e1e4acd4d node DatanodeRegistration(127.0.0.1, datanodeUuid=0df010f0-0045-4516-a221-4fde25739ae1, infoPort=56876, ipcPort=57434, storageInfo=lv=-56;cid=testClusterID;nsid=183200476;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 1238090 INFO  (IPC Server handler 8 on 33281) [    ] BlockStateChange BLOCK* processReport: from storage DS-3e7315dc-cc46-4cda-891d-078702ecd4d5 node DatanodeRegistration(127.0.0.1, datanodeUuid=0df010f0-0045-4516-a221-4fde25739ae1, infoPort=56876, ipcPort=57434, storageInfo=lv=-56;cid=testClusterID;nsid=183200476;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 1238179 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1238179 INFO  (Thread-4202) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1238180 INFO  (Thread-4202) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1238279 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.ZkTestServer start zk server on port:36373
   [junit4]   2> 1238280 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1238280 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1238288 INFO  (zkCallback-790-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4147874b name:ZooKeeperConnection Watcher:127.0.0.1:36373 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1238288 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1238288 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1238288 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1238292 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1238293 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1238298 INFO  (zkCallback-791-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@61c9b099 name:ZooKeeperConnection Watcher:127.0.0.1:36373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1238298 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1238299 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1238299 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1238303 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1238305 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1238306 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1238308 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1238308 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1238313 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1238313 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1238316 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1238316 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1238318 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1238319 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1238320 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1238320 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1238322 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1238322 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1238325 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1238325 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1238326 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1238327 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1238328 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1238328 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1238331 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1238331 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1238333 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1238333 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1238336 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1238337 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1238338 INFO  (zkCallback-792-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f5c68b8 name:ZooKeeperConnection Watcher:127.0.0.1:36373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1238338 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1238338 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1238339 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1238340 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1238340 INFO  (zkCallback-793-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4d34998a name:ZooKeeperConnection Watcher:127.0.0.1:36373 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1238341 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1238341 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1238341 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1238342 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1238343 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1238345 INFO  (zkCallback-794-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66287361 name:ZooKeeperConnection Watcher:127.0.0.1:36373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1238345 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1238346 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1238346 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1238346 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1238348 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1238349 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 1238351 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
   [junit4]   2> 1238351 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 1238352 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1238353 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1238355 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1238355 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1238357 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1238357 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1238359 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1238359 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 1238360 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1238360 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1238362 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1238362 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1238363 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1238364 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1238366 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1238366 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1238367 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1238368 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1238666 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores/collection1
   [junit4]   2> 1238668 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 1238670 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@44bb12a9{/,null,AVAILABLE}
   [junit4]   2> 1238674 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3dc2a9e1{SSL-http/1.1}{127.0.0.1:51222}
   [junit4]   2> 1238674 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.Server Started @1242563ms
   [junit4]   2> 1238674 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:33281/hdfs__localhost_33281__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001_tempDir-002_control_data, hostContext=/, hostPort=51222, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores}
   [junit4]   2> 1238681 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
   [junit4]   2> 1238682 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/'
   [junit4]   2> 1238704 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/solr.xml
   [junit4]   2> 1238710 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores
   [junit4]   2> 1238710 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoreContainer New CoreContainer 1334841924
   [junit4]   2> 1238710 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/]
   [junit4]   2> 1238710 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/lib
   [junit4]   2> 1238711 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/lib).
   [junit4]   2> 1238719 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1238721 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1238724 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1238724 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1238725 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36373/solr
   [junit4]   2> 1238725 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1238725 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1238727 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1238727 INFO  (zkCallback-796-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6aebe2d6 name:ZooKeeperConnection Watcher:127.0.0.1:36373 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1238728 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1238729 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1238730 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1238731 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@334c139f name:ZooKeeperConnection Watcher:127.0.0.1:36373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1238732 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1238733 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1238735 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1238738 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1238740 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1238741 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1238744 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1238745 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1238746 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1238748 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51222_
   [junit4]   2> 1238749 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:51222_
   [junit4]   2> 1238750 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1238752 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1238754 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1238755 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94097665657929734-127.0.0.1:51222_-n_0000000000
   [junit4]   2> 1238755 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51222_
   [junit4]   2> 1238756 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1238757 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer Overseer (id=94097665657929734-127.0.0.1:51222_-n_0000000000) starting
   [junit4]   2> 1238759 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1238765 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1238765 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1238766 INFO  (OverseerCollectionProcessor-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.OverseerCollectionProcessor Process current queue of collection creations
   [junit4]   2> 1238767 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1238768 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1238769 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1238770 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores
   [junit4]   2> 1238771 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1238771 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores/collection1/
   [junit4]   2> 1238771 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1238773 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2
   [junit4]   2> 1238773 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [n:127.0.0.1:51222_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1238775 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1238775 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1238775 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1238775 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1238776 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:51222",
   [junit4]   2>   "node_name":"127.0.0.1:51222_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1238778 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:51222",
   [junit4]   2>   "node_name":"127.0.0.1:51222_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1238778 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1238778 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1238779 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1238780 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 1
   [junit4]   2> 1239777 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1239777 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1239778 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1239778 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1239779 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1239779 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores/collection1/'
   [junit4]   2> 1239795 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1239801 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1239824 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1239832 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1239833 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1239838 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1239937 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1239943 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1239944 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1239957 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1239961 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1239963 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1239964 WARN  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1239964 WARN  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1239965 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1239965 WARN  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1239966 WARN  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1239966 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1239966 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 1239966 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:33281/solr_hdfs_home
   [junit4]   2> 1239966 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1239966 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1239967 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@43781405
   [junit4]   2> 1239967 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 1239996 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data for locality metrics.
   [junit4]   2> 1239997 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 1240000 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 1240008 WARN  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:33281/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1240009 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 1240023 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data/index for locality metrics.
   [junit4]   2> 1240023 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 1240023 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=38.2861328125, floorSegmentMB=0.4794921875, forceMergeDeletesPctAllowed=14.68393512629107, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5777160272865353
   [junit4]   2> 1240053 INFO  (IPC Server handler 1 on 33281) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39974 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-8397aa60-b007-44b7-9aa2-217e1e4acd4d:NORMAL:127.0.0.1:42563|RBW], ReplicaUnderConstruction[[DISK]DS-bcfae989-3d43-47bd-aa2e-21050c2985c9:NORMAL:127.0.0.1:39974|FINALIZED]]} size 0
   [junit4]   2> 1240058 INFO  (IPC Server handler 6 on 33281) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:42563 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-8397aa60-b007-44b7-9aa2-217e1e4acd4d:NORMAL:127.0.0.1:42563|RBW], ReplicaUnderConstruction[[DISK]DS-bcfae989-3d43-47bd-aa2e-21050c2985c9:NORMAL:127.0.0.1:39974|FINALIZED]]} size 0
   [junit4]   2> 1240065 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b6071213 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7efc5501; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 1240065 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1240067 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:33281/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 1240070 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1240070 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1240070 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1240071 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1240071 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1240071 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1240071 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1240073 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1240073 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1240075 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1240077 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1240081 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1240084 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1240087 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1240088 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1240088 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1240088 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 1240106 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1240107 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1240108 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@5075a3a8
   [junit4]   2> 1240134 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(HdfsDirectory@b6071213 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7efc5501; maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 1240134 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1240135 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@606af5d8[collection1] main
   [junit4]   2> 1240135 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1240136 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1240136 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1240137 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1240137 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1240137 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1240138 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1240138 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1240139 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1240139 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1240139 INFO  (searcherExecutor-2427-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@606af5d8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1240141 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1240141 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 1240141 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1240142 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1505562652582084608
   [junit4]   2> 1240142 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1 ms to seed version buckets with highest version 1505562652582084608
   [junit4]   2> 1240142 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1240142 INFO  (coreLoadExecutor-2426-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1240143 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:51222 collection:control_collection shard:shard1
   [junit4]   2> 1240144 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1240147 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94097665657929734-core_node1-n_0000000000
   [junit4]   2> 1240148 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1240149 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1240149 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1240149 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1240149 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1240150 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:51222/collection1/
   [junit4]   2> 1240150 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1240150 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:51222/collection1/ has no replicas
   [junit4]   2> 1240150 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:51222/collection1/ shard1
   [junit4]   2> 1240150 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1240153 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1240154 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:51222",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1240256 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1240257 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 2
   [junit4]   2> 1240277 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1240289 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1240290 INFO  (zkCallback-799-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@120fb556 name:ZooKeeperConnection Watcher:127.0.0.1:36373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1240290 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1240290 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1240291 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1240293 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1240293 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1240293 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1240296 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1240299 INFO  (zkCallback-800-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ebc9a95 name:ZooKeeperConnection Watcher:127.0.0.1:36373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1240299 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1240300 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1240301 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1240302 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 1240302 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1240305 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:51222/collection1/ and leader is https://127.0.0.1:51222/collection1/
   [junit4]   2> 1240305 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51222
   [junit4]   2> 1240305 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1240305 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1240305 INFO  (coreZkRegister-2420-thread-1-processing-n:127.0.0.1:51222_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:51222_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1240306 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1240306 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:51222",
   [junit4]   2>   "node_name":"127.0.0.1:51222_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1240307 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:51222",
   [junit4]   2>   "node_name":"127.0.0.1:51222_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1240308 INFO  (OverseerStateUpdate-94097665657929734-127.0.0.1:51222_-n_0000000000) [n:127.0.0.1:51222_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1240308 INFO  (zkCallback-799-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1240309 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1240311 INFO  (zkCallback-799-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
   [junit4]   2> 1240311 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 3
   [junit4]   2> 1240413 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1240413 INFO  (zkCallback-799-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1240414 INFO  (zkCallback-797-thread-1-processing-n:127.0.0.1:51222_) [n:127.0.0.1:51222_    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
   [junit4]   2> 1240416 INFO  (zkCallback-799-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated cluster state version to 4
   [junit4]   2> 1240724 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/cores/collection1
   [junit4]   2> 1240725 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001
   [junit4]   2> 1240727 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 1240731 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@177551ca{/,null,AVAILABLE}
   [junit4]   2> 1240735 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.ServerConnector Started ServerConnector@4948f963{SSL-http/1.1}{127.0.0.1:35332}
   [junit4]   2> 1240735 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.e.j.s.Server Started @1244624ms
   [junit4]   2> 1240736 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:33281/hdfs__localhost_33281__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J2_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=35332, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/cores}
   [junit4]   2> 1240737 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@c387f44
   [junit4]   2> 1240738 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/'
   [junit4]   2> 1240759 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/solr.xml
   [junit4]   2> 1240766 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/cores
   [junit4]   2> 1240766 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoreContainer New CoreContainer 1394064786
   [junit4]   2> 1240766 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/]
   [junit4]   2> 1240766 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/lib
   [junit4]   2> 1240767 WARN  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_390C9E12426711EC-001/shard-1-001/lib).
   [junit4]   2> 1240779 INFO  (TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[390C9E12426711EC]) [    ] o.a.s.h.c.HttpShardHan

[...truncated too long message...]

lrCore org.apache.solr.core.SolrCore@43e86e16
   [junit4]   2> 3354227 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=10,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=4,cumulative_deletesById=0,cumulative_deletesByQuery=2,cumulative_errors=0}
   [junit4]   2> 3354227 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 3354228 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 3354228 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 3354228 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 3354228 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 3354229 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_390C9E12426711EC-001/init-core-data-001 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_390C9E12426711EC-001/init-core-data-001;done=false>>]
   [junit4]   2> 3354229 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_390C9E12426711EC-001/init-core-data-001
   [junit4]   2> 3354229 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_390C9E12426711EC-001/init-core-data-001/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_390C9E12426711EC-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 3354229 INFO  (SUITE-TestSearcherReuse-seed#[390C9E12426711EC]-worker) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_390C9E12426711EC-001/init-core-data-001/index
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.search.TestSearcherReuse_390C9E12426711EC-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53), sim=DefaultSimilarity, locale=sr_RS_#Latn, timezone=Africa/Gaborone
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_25 (64-bit)/cpus=4,threads=1,free=205249184,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: [TestObjectReleaseTracker, TestStressRecovery, TestRawResponseWriter, CustomCollectionTest, UnloadDistributedZkTest, CoreMergeIndexesAdminHandlerTest, HdfsDirectoryTest, TestShortCircuitedRequests, DistributedDebugComponentTest, TestSchemaSimilarityResource, QueryEqualityTest, TestXIncludeConfig, SharedFSAutoReplicaFailoverTest, TestGroupingSearch, TestSolrXml, TestSort, TestReqParamsAPI, FullSolrCloudDistribCmdsTest, TestExactSharedStatsCache, DistributedFacetPivotSmallAdvancedTest, BinaryUpdateRequestHandlerTest, TestInitParams, TestLRUStatsCache, TestQuerySenderNoQuery, PrimUtilsTest, CursorPagingTest, OverriddenZkACLAndCredentialsProvidersTest, TestReplicationHandlerBackup, TestStressReorder, OutputWriterTest, XmlUpdateRequestHandlerTest, TestNoOpRegenerator, SolrIndexSplitterTest, PathHierarchyTokenizerFactoryTest, SimpleFacetsTest, TestSolrConfigHandlerConcurrent, TestSolrCloudWithKerberosAlt, LeaderInitiatedRecoveryOnCommitTest, TestQueryTypes, TestTrie, TestFieldCollectionResource, HardAutoCommitTest, DistributedVersionInfoTest, BadIndexSchemaTest, TestDocSet, TestFieldTypeResource, CloudExitableDirectoryReaderTest, TestSurroundQueryParser, TestUniqueKeyFieldResource, TestHashQParserPlugin, SearchHandlerTest, HdfsNNFailoverTest, TestHdfsUpdateLog, OverseerTest, VersionInfoTest, SortByFunctionTest, DistributedSuggestComponentTest, ChangedSchemaMergeTest, HdfsCollectionsAPIDistributedZkTest, TestTolerantSearch, TestClassNameShortening, ReplicationFactorTest, TestDynamicFieldCollectionResource, ResponseLogComponentTest, DistanceUnitsTest, DirectUpdateHandlerOptimizeTest, OverseerCollectionProcessorTest, LoggingHandlerTest, CircularListTest, TestSolrJ, SolrCoreCheckLockOnStartupTest, AddBlockUpdateTest, HdfsRecoveryZkTest, TestReloadAndDeleteDocs, BasicDistributedZk2Test, SoftAutoCommitTest, DistribJoinFromCollectionTest, SpellCheckCollatorTest, CollectionReloadTest, TestFastOutputStream, QueryParsingTest, CollectionsAPIDistributedZkTest, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, TestHashPartitioner, ZkControllerTest, TestReload, DistributedTermsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, DirectUpdateHandlerTest, DistributedQueryElevationComponentTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SuggesterTest, TestPseudoReturnFields, TestAtomicUpdateErrorCases, DistanceFunctionTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, TestQueryUtils, DirectSolrSpellCheckerTest, FileBasedSpellCheckerTest, RequestHandlersTest, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestPartialUpdateDeduplication, TestBinaryResponseWriter, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestMergePolicyConfig, SampleTest, TestBinaryField, NumericFieldsTest, TestConfig, ExternalFileFieldSortTest, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, EchoParamsTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestBM25SimilarityFactory, TestDefaultSimilarityFactory, TestFastWriter, TestJmxMonitoredMap, TimeZoneUtilsTest, ResourceLoaderTest, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, ChaosMonkeyNothingIsSafeTest, CdcrVersionReplicationTest, CollectionsAPIAsyncDistributedZkTest, ConnectionManagerTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribCursorPagingTest, MultiThreadedOCPTest, OverseerStatusTest, RecoveryAfterSoftCommitTest, SaslZkACLProviderTest, SimpleCollectionCreateDeleteTest, SolrCloudExampleTest, SolrXmlInZkTest, TestCloudInspectUtil, TestCollectionAPI, TestCryptoKeys, TestDownShardTolerantSearch, TestMiniSolrCloudClusterSSL, TestReplicaProperties, TestRequestStatusCollectionAPI, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, TestClusterStateMutator, ZkStateWriterTest, RuleEngineTest, RulesTest, TestSolrConfigHandler, TestRestoreCore, TestSQLHandler, DistributedExpandComponentTest, DistributedFacetPivotWhiteBoxTest, DistributedQueryComponentCustomSortTest, DistributedQueryComponentOptimizationTest, TestCopyFieldCollectionResource, TestDefaultSearchFieldResource, TestDynamicFieldResource, TestFieldResource, TestFieldTypeCollectionResource, TestManagedSchemaFieldTypeResource, TestRemoveLastDynamicCopyField, TestSchemaNameResource, TestSchemaResource, TestSolrQueryParserDefaultOperatorResource, TestSolrQueryParserResource, TestManagedStopFilterFactory, SpatialRPTFieldTypeTest, TestSchemaManager, CursorMarkTest, MergeStrategyTest, TestSearcherReuse]
   [junit4] Completed [483/514] on J2 in 0.28s, 1 test, 1 failure <<< FAILURES!

[...truncated 105 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:533: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:513: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1426: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:981: There were test failures: 514 suites, 2021 tests, 1 error, 1 failure, 20 ignored (10 assumptions)

Total time: 164 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message