lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-master - Build # 961 - Still Failing
Date Tue, 15 Mar 2016 16:19:37 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-master/961/

3 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=33627, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=33627, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
	at __randomizedtesting.SeedInfo.seed([538251DAECEAF638:DBD66E0042169BC0]:0)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53473: collection already exists: awholynewstresscollection_collection4_8
	at __randomizedtesting.SeedInfo.seed([538251DAECEAF638]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:970)


FAILED:  org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=59391, name=testExecutor-2516-thread-1, state=RUNNABLE, group=TGRP-HdfsUnloadDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=59391, name=testExecutor-2516-thread-1, state=RUNNABLE, group=TGRP-HdfsUnloadDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:41575
	at __randomizedtesting.SeedInfo.seed([538251DAECEAF638]:0)
	at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCores$3(BasicDistributedZkTest.java:583)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$6(ExecutorUtil.java:229)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:41575
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCores$3(BasicDistributedZkTest.java:581)
	... 4 more
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 11 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 11 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
	at __randomizedtesting.SeedInfo.seed([538251DAECEAF638]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11748 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/init-core-data-001
   [junit4]   2> 1852239 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 1852277 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 1852291 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1852294 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1852314 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_48801_hdfs____734vkv/webapp
   [junit4]   2> 1852411 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1852735 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:48801
   [junit4]   2> 1852809 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1852810 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1852826 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_44461_datanode____o2r8wm/webapp
   [junit4]   2> 1852921 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1853223 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44461
   [junit4]   2> 1853261 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 1853262 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 1853275 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_56795_datanode____.b5lq6f/webapp
   [junit4]   2> 1853322 INFO  (IPC Server handler 3 on 37225) [    ] BlockStateChange BLOCK* processReport: from storage DS-80d08a90-341f-41ed-9ca3-b44221031d50 node DatanodeRegistration(127.0.0.1, datanodeUuid=78e5c842-cb4e-49a4-be1d-9c1a1db5836d, infoPort=44461, ipcPort=45479, storageInfo=lv=-56;cid=testClusterID;nsid=1340535509;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 1853322 INFO  (IPC Server handler 3 on 37225) [    ] BlockStateChange BLOCK* processReport: from storage DS-25d2a8a0-f018-46d8-b8b8-e4a3748ea194 node DatanodeRegistration(127.0.0.1, datanodeUuid=78e5c842-cb4e-49a4-be1d-9c1a1db5836d, infoPort=44461, ipcPort=45479, storageInfo=lv=-56;cid=testClusterID;nsid=1340535509;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 1853390 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 1853634 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[538251DAECEAF638]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56795
   [junit4]   2> 1853805 INFO  (IPC Server handler 2 on 37225) [    ] BlockStateChange BLOCK* processReport: from storage DS-b0496c59-4317-4cfe-8b4c-af244a3d936d node DatanodeRegistration(127.0.0.1, datanodeUuid=915850e8-df04-432f-a4b4-e8d94dc1ccb5, infoPort=56795, ipcPort=47626, storageInfo=lv=-56;cid=testClusterID;nsid=1340535509;c=0), blocks: 0, hasStaleStorages: true, processing time: 1 msecs
   [junit4]   2> 1853805 INFO  (IPC Server handler 2 on 37225) [    ] BlockStateChange BLOCK* processReport: from storage DS-14684c47-ab37-4ae2-b977-53e8812ef157 node DatanodeRegistration(127.0.0.1, datanodeUuid=915850e8-df04-432f-a4b4-e8d94dc1ccb5, infoPort=56795, ipcPort=47626, storageInfo=lv=-56;cid=testClusterID;nsid=1340535509;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 1853957 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1853957 INFO  (Thread-52783) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1853957 INFO  (Thread-52783) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1854057 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.ZkTestServer start zk server on port:59145
   [junit4]   2> 1854058 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1854058 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1854062 INFO  (zkCallback-1010-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@51020533 name:ZooKeeperConnection Watcher:127.0.0.1:59145 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1854062 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1854062 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1854063 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1854065 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1854065 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1537adeff6c0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1854066 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1854068 INFO  (zkCallback-1011-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@651edf22 name:ZooKeeperConnection Watcher:127.0.0.1:59145/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1854068 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1854068 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1854069 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1854070 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1854072 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1854073 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1854075 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1854075 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1854078 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1854078 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1854080 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1854080 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1854082 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1854082 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1854084 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1854084 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1854086 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1854086 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1854087 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1854088 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1854089 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1854089 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1854091 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1854091 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1854093 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1854093 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1854094 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1854095 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1854186 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/cores/collection1
   [junit4]   2> 1854188 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1854191 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2e2e6aa9{/,null,AVAILABLE}
   [junit4]   2> 1854191 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.ServerConnector Started ServerConnector@2a9fd34e{HTTP/1.1,[http/1.1]}{127.0.0.1:47269}
   [junit4]   2> 1854191 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.Server Started @1857465ms
   [junit4]   2> 1854191 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:37225/hdfs__localhost_37225__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-master_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001_tempDir-002_control_data, hostContext=/, hostPort=47269, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/cores}
   [junit4]   2> 1854191 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1854191 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001'
   [junit4]   2> 1854192 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1854192 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1854192 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1854197 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1854206 INFO  (zkCallback-1012-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c1c3979 name:ZooKeeperConnection Watcher:127.0.0.1:59145/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1854206 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1854207 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1854208 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1854208 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/solr.xml
   [junit4]   2> 1854212 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/cores
   [junit4]   2> 1854213 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CoreContainer New CoreContainer 1039579139
   [junit4]   2> 1854213 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001]
   [junit4]   2> 1854213 WARN  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/lib
   [junit4]   2> 1854213 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1854214 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1854215 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1854215 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1854215 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59145/solr
   [junit4]   2> 1854215 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1854215 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1854221 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1854221 INFO  (zkCallback-1015-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2de2cf7f name:ZooKeeperConnection Watcher:127.0.0.1:59145 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1854222 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1854222 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1854224 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1854230 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1c96666c name:ZooKeeperConnection Watcher:127.0.0.1:59145/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1854230 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1854231 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1854232 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1854235 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1854236 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1854238 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1854239 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1854241 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1854242 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1854242 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1854243 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1854244 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1854246 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1854247 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1854247 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1854248 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95555115291508740-127.0.0.1:47269_-n_0000000000
   [junit4]   2> 1854248 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:47269_
   [junit4]   2> 1854248 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1854249 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer Overseer (id=95555115291508740-127.0.0.1:47269_-n_0000000000) starting
   [junit4]   2> 1854251 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1854255 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1854256 INFO  (OverseerCollectionConfigSetProcessor-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1854256 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47269_
   [junit4]   2> 1854256 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1854258 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47269_
   [junit4]   2> 1854259 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1854259 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1854260 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1854268 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1854268 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1854269 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/cores
   [junit4]   2> 1854270 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1854270 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/cores/collection1
   [junit4]   2> 1854270 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1854271 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0
   [junit4]   2> 1854271 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:47269_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1854271 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1854271 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1854272 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:47269",
   [junit4]   2>   "node_name":"127.0.0.1:47269_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1854273 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1854273 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:47269",
   [junit4]   2>   "node_name":"127.0.0.1:47269_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1854273 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1854274 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1854275 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1855273 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1855273 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1855274 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1855274 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1855275 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1855275 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/cores/collection1'
   [junit4]   2> 1855275 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1855275 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1855277 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1855284 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1855287 WARN  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1855288 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1855299 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1855304 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1856337 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1856345 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1856346 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1856354 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1856357 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1856358 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1856359 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1856361 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0
   [junit4]   2> 1856361 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1856361 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 1856361 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:37225/solr_hdfs_home
   [junit4]   2> 1856361 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 1856361 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/control-001/cores/collection1], dataDir=[hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 1856362 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b6ea419
   [junit4]   2> 1856362 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 1856386 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 1856387 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 1856403 WARN  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:37225/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1856404 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 1856410 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 1856411 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 1856418 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 1856419 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 1856419 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=38.0361328125, floorSegmentMB=1.09765625, forceMergeDeletesPctAllowed=25.60584582007546, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3152188092195133
   [junit4]   2> 1856445 INFO  (IPC Server handler 9 on 37225) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44937 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-b0496c59-4317-4cfe-8b4c-af244a3d936d:NORMAL:127.0.0.1:39954|RBW], ReplicaUnderConstruction[[DISK]DS-80d08a90-341f-41ed-9ca3-b44221031d50:NORMAL:127.0.0.1:44937|RBW]]} size 0
   [junit4]   2> 1856449 INFO  (IPC Server handler 8 on 37225) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:39954 is added to blk_1073741825_1001 size 71
   [junit4]   2> 1856453 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@156d598c); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 1856453 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1856463 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1856463 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1856463 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1856463 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1856464 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1856464 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1856464 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1856464 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1856464 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1856464 WARN  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1856466 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1856467 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1856468 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1856469 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1856472 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 1856472 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1856472 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 1856478 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 1856478 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 1856490 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1856490 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1856491 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1856499 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:37225/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@156d598c); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 1856499 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1856499 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@350499f2[collection1] main]
   [junit4]   2> 1856499 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1856500 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1856500 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1856500 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1856500 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1856500 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1856501 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1856501 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1856501 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1856501 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1856502 INFO  (searcherExecutor-2439-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@350499f2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1856503 WARN  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.h.HdfsLocalityReporter Could not retrieve locality information for hdfs://localhost:47707/solr3 due to exception: java.net.ConnectException: Call From lucene1-us-west/10.41.0.5 to localhost:47707 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
   [junit4]   2> 1856503 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1856503 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 1856503 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1856503 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1528881847332765696
   [junit4]   2> 1856503 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1528881847332765696
   [junit4]   2> 1856503 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1856504 INFO  (coreLoadExecutor-2438-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1856506 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:47269 collection:control_collection shard:shard1
   [junit4]   2> 1856506 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1856509 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95555115291508740-core_node1-n_0000000000
   [junit4]   2> 1856509 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 1856511 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1856512 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1856514 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1856514 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1856514 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:47269/collection1/
   [junit4]   2> 1856514 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1856514 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:47269/collection1/ has no replicas
   [junit4]   2> 1856515 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1856517 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95555115291508740-core_node1-n_0000000000
   [junit4]   2> 1856519 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:47269",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 2
   [junit4]   2> 1856520 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:47269/collection1/ shard1
   [junit4]   2> 1856621 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1856623 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:47269/collection1/ and leader is http://127.0.0.1:47269/collection1/
   [junit4]   2> 1856623 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47269
   [junit4]   2> 1856623 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1856623 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1856624 INFO  (coreZkRegister-2432-thread-1-processing-n:127.0.0.1:47269_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:47269_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1856625 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:47269",
   [junit4]   2>   "node_name":"127.0.0.1:47269_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 1856626 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:47269",
   [junit4]   2>   "node_name":"127.0.0.1:47269_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1856728 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1856729 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1856729 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1856739 INFO  (zkCallback-1018-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1362ce75 name:ZooKeeperConnection Watcher:127.0.0.1:59145/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1856739 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1856739 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1856740 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1856741 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1856742 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1856886 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001/cores/collection1
   [junit4]   2> 1856887 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001
   [junit4]   2> 1856888 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1856906 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6eaf45ca{/,null,AVAILABLE}
   [junit4]   2> 1856906 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.ServerConnector Started ServerConnector@58b665b1{HTTP/1.1,[http/1.1]}{127.0.0.1:60438}
   [junit4]   2> 1856906 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.e.j.s.Server Started @1860180ms
   [junit4]   2> 1856906 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:37225/hdfs__localhost_37225__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-master_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=60438, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001/cores}
   [junit4]   2> 1856907 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1856907 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001'
   [junit4]   2> 1856907 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1856907 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1856907 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1856915 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1856925 INFO  (zkCallback-1019-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@17f87c90 name:ZooKeeperConnection Watcher:127.0.0.1:59145/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1856925 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1856925 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1856929 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1856929 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001/solr.xml
   [junit4]   2> 1856934 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001/cores
   [junit4]   2> 1856934 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CoreContainer New CoreContainer 1460140207
   [junit4]   2> 1856934 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001]
   [junit4]   2> 1856935 WARN  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_538251DAECEAF638-001/shard-1-001/lib
   [junit4]   2> 1856936 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1856937 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1856937 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1856937 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1856937 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:59145/solr
   [junit4]   2> 1856937 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1856937 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1856942 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1856945 INFO  (zkCallback-1022-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@30865cb3 name:ZooKeeperConnection Watcher:127.0.0.1:59145 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1856946 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1856946 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1856951 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1856953 INFO  (zkCallback-1023-thread-1-processing-n:127.0.0.1:60438_) [n:127.0.0.1:60438_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@656a68c2 name:ZooKeeperConnection Watcher:127.0.0.1:59145/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1856953 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1856958 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1856959 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1856960 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1856961 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95555115291508744-127.0.0.1:60438_-n_0000000001
   [junit4]   2> 1856961 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95555115291508740-127.0.0.1:47269_-n_0000000000 to know if I could be the leader
   [junit4]   2> 1856962 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.ZkController Publish node=127.0.0.1:60438_ as DOWN
   [junit4]   2> 1856964 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:60438_"} current state version: 4
   [junit4]   2> 1856964 INFO  (OverseerStateUpdate-95555115291508740-127.0.0.1:47269_-n_0000000000) [n:127.0.0.1:47269_    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:60438_
   [junit4]   2> 1857066 INFO  (zkCallback-1023-thread-1-processing-n:127.0.0.1:60438_) [n:127.0.0.1:60438_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1857066 INFO  (zkCallback-1018-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1857066 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1857964 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60438_
   [junit4]   2> 1857964 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60438_
   [junit4]   2> 1857965 INFO  (zkCallback-1023-thread-1-processing-n:127.0.0.1:60438_) [n:127.0.0.1:60438_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1857965 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1857965 INFO  (zkCallback-1018-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1857966 INFO  (zkCallback-1023-thread-1-processing-n:127.0.0.1:60438_) [n:127.0.0.1:60438_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1857966 INFO  (zkCallback-1016-thread-1-processing-n:127.0.0.1:47269_) [n:127.0.0.1:47269_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1857966 INFO  (zkCallback-1018-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1857990 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1857990 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1857991 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[538251DAECEAF638]) [n:127.0.0.1:60438_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistribute

[...truncated too long message...]

junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:351)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:386)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:270)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:387)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:275)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=Lucene60, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=hr, timezone=Australia/ACT
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=25861320,total=531628032
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrIndexConfig, TestFuzzyAnalyzedSuggestions, TestIndexSearcher, AnalyticsMergeStrategyTest, SuggesterTSTTest, UnloadDistributedZkTest, DistribJoinFromCollectionTest, HardAutoCommitTest, DocValuesMissingTest, BadComponentTest, TestReversedWildcardFilterFactory, FullHLLTest, TestUniqueKeyFieldResource, TestDFISimilarityFactory, LukeRequestHandlerTest, TestReload, TestFastWriter, TestBlendedInfixSuggestions, TestConfigOverlay, TestElisionMultitermQuery, TestStressRecovery, ScriptEngineTest, TestMacros, VMParamsZkACLAndCredentialsProvidersTest, TestTolerantSearch, BasicAuthIntegrationTest, DebugComponentTest, DirectUpdateHandlerOptimizeTest, TestUtils, SolrCoreCheckLockOnStartupTest, OverseerCollectionConfigSetProcessorTest, CollectionsAPISolrJTest, TestGroupingSearch, TestHighFrequencyDictionaryFactory, SparseHLLTest, HdfsTlogReplayBufferedWhileIndexingTest, TestSmileRequest, TestCharFilters, SolrCloudExampleTest, SearchHandlerTest, OverseerTaskQueueTest, CoreAdminRequestStatusTest, CoreAdminHandlerTest, TestCloudSchemaless, TestCollationField, HdfsChaosMonkeyNothingIsSafeTest, TestZkChroot, DirectUpdateHandlerTest, TestSearchPerf, ZkStateWriterTest, TestPerFieldSimilarity, TestSchemaManager, CircularListTest, BadCopyFieldTest, TestReloadDeadlock, DocValuesMultiTest, TestSolrConfigHandlerCloud, TestSuggestSpellingConverter, TestExtendedDismaxParser, ReplicationFactorTest, DistributedFacetPivotSmallAdvancedTest, CloudMLTQParserTest, CurrencyFieldXmlFileTest, TestScoreJoinQPNoScore, RequestHandlersTest, OverseerTest, RulesTest, RegexBoostProcessorTest, HighlighterMaxOffsetTest, TestRequestStatusCollectionAPI, MultiThreadedOCPTest, TestDownShardTolerantSearch, TestSortingResponseWriter, SharedFSAutoReplicaFailoverTest, AssignTest, AtomicUpdatesTest, TestBlobHandler, RecoveryZkTest, TestAddFieldRealTimeGet, DeleteStatusTest, PrimitiveFieldTypeTest, FieldMutatingUpdateProcessorTest, TestSolrCloudWithKerberosAlt, ExitableDirectoryReaderTest, TestSolrDynamicMBean, SuggesterTest, DataDrivenBlockJoinTest, TestStressReorder, TestRestManager, CleanupOldIndexTest, TestSortByMinMaxFunction, TestSort, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandler -Dtests.seed=538251DAECEAF638 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hr -Dtests.timezone=Australia/ACT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | TestReplicationHandler (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ObjectTracker found 11 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([538251DAECEAF638]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4] Completed [433/579 (3!)] on J2 in 692.25s, 13 tests, 1 failure <<< FAILURES!

[...truncated 459 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-master/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2312 tests, 1 suite-level error, 2 errors, 32 ignored (16 assumptions) [seed: 538251DAECEAF638]

Total time: 220 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message