lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 939 - Still Failing
Date Sat, 20 Feb 2016 22:09:55 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/939/

1 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=48654, name=testExecutor-8080-thread-4, state=RUNNABLE, group=TGRP-HdfsUnloadDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=48654, name=testExecutor-8080-thread-4, state=RUNNABLE, group=TGRP-HdfsUnloadDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:52112/g_m/xa
	at __randomizedtesting.SeedInfo.seed([743680B31E0433AB]:0)
	at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:586)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:231)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:52112/g_m/xa
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:588)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.BasicDistributedZkTest$1.run(BasicDistributedZkTest.java:584)
	... 4 more
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
	at java.net.SocketInputStream.read(SocketInputStream.java:170)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 8 more




Build Log:
[...truncated 12283 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/init-core-data-001
   [junit4]   2> 3784867 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /g_m/xa
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 3784901 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 3784906 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 3784908 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 3784923 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_51747_hdfs____.xa3l2w/webapp
   [junit4]   2> 3785025 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 3785321 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:51747
   [junit4]   2> 3785382 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 3785383 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 3785400 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_36362_datanode____q1zff7/webapp
   [junit4]   2> 3785501 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 3785783 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36362
   [junit4]   2> 3785819 WARN  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 3785820 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 3785837 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_60800_datanode____.qrih97/webapp
   [junit4]   2> 3785857 INFO  (IPC Server handler 3 on 40370) [    ] BlockStateChange BLOCK* processReport: from storage DS-f9810188-0ecd-4333-8cfb-02f856bfe153 node DatanodeRegistration(127.0.0.1, datanodeUuid=d44b2ccd-7290-4f7e-aa62-86880cb005db, infoPort=36362, ipcPort=55368, storageInfo=lv=-56;cid=testClusterID;nsid=1325674798;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 3785857 INFO  (IPC Server handler 3 on 40370) [    ] BlockStateChange BLOCK* processReport: from storage DS-2f809f47-0520-467a-8ae8-68d27f14b98a node DatanodeRegistration(127.0.0.1, datanodeUuid=d44b2ccd-7290-4f7e-aa62-86880cb005db, infoPort=36362, ipcPort=55368, storageInfo=lv=-56;cid=testClusterID;nsid=1325674798;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 3785949 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 3786256 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:60800
   [junit4]   2> 3786336 INFO  (IPC Server handler 8 on 40370) [    ] BlockStateChange BLOCK* processReport: from storage DS-f2049002-05ca-4bf7-8dd9-b08399cf248d node DatanodeRegistration(127.0.0.1, datanodeUuid=a12ea222-fef9-49b1-9773-666e8bcfd9ef, infoPort=60800, ipcPort=49574, storageInfo=lv=-56;cid=testClusterID;nsid=1325674798;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 3786337 INFO  (IPC Server handler 8 on 40370) [    ] BlockStateChange BLOCK* processReport: from storage DS-842676d3-2eb8-46d1-9574-da62ea400236 node DatanodeRegistration(127.0.0.1, datanodeUuid=a12ea222-fef9-49b1-9773-666e8bcfd9ef, infoPort=60800, ipcPort=49574, storageInfo=lv=-56;cid=testClusterID;nsid=1325674798;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 3786435 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3786436 INFO  (Thread-17589) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3786436 INFO  (Thread-17589) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 3786536 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.ZkTestServer start zk server on port:36610
   [junit4]   2> 3786536 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3786536 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3786539 INFO  (zkCallback-4040-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4fda5973 name:ZooKeeperConnection Watcher:127.0.0.1:36610 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3786539 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3786539 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3786539 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 3786542 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3786542 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3786543 INFO  (zkCallback-4041-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2eca9c20 name:ZooKeeperConnection Watcher:127.0.0.1:36610/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3786543 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3786543 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3786543 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 3786545 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 3786546 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 3786547 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 3786549 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 3786549 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 3786551 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 3786551 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 3786553 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3786553 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3786555 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 3786555 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 3786556 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 3786556 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 3786557 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 3786558 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 3786559 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3786559 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 3786560 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3786561 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3786562 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3786562 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3786564 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3786564 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 3786565 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 3786565 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 3786657 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/cores/collection1
   [junit4]   2> 3786659 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 3786660 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e5e9a6d{/g_m/xa,null,AVAILABLE}
   [junit4]   2> 3786661 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@41d73301{HTTP/1.1,[http/1.1]}{127.0.0.1:44714}
   [junit4]   2> 3786662 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.Server Started @3790244ms
   [junit4]   2> 3786662 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40370/hdfs__localhost_40370__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001_tempDir-002_control_data, hostContext=/g_m/xa, hostPort=44714, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/cores}
   [junit4]   2> 3786662 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 3786662 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001'
   [junit4]   2> 3786662 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3786662 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3786663 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3786663 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3786664 INFO  (zkCallback-4042-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ab530f8 name:ZooKeeperConnection Watcher:127.0.0.1:36610/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3786664 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3786664 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3786665 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 3786665 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/solr.xml
   [junit4]   2> 3786670 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/cores
   [junit4]   2> 3786670 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CoreContainer New CoreContainer 1434198086
   [junit4]   2> 3786670 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001]
   [junit4]   2> 3786671 WARN  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/lib
   [junit4]   2> 3786671 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 3786672 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 3786672 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3786672 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3786673 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36610/solr
   [junit4]   2> 3786673 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 3786673 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3786673 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3786674 INFO  (zkCallback-4045-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5a5458be name:ZooKeeperConnection Watcher:127.0.0.1:36610 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3786674 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3786675 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3786676 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3786676 INFO  (zkCallback-4046-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@428e929c name:ZooKeeperConnection Watcher:127.0.0.1:36610/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3786676 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3786677 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 3786679 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 3786681 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 3786683 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 3786684 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 3786686 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 3786687 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 3786688 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 3786690 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 3786691 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44714_g_m%2Fxa
   [junit4]   2> 3786691 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44714_g_m%2Fxa
   [junit4]   2> 3786693 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 3786694 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 3786695 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3786695 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000
   [junit4]   2> 3786696 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44714_g_m%2Fxa
   [junit4]   2> 3786696 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 3786697 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer Overseer (id=95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) starting
   [junit4]   2> 3786698 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 3786703 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 3786706 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3786706 INFO  (OverseerCollectionConfigSetProcessor-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 3786707 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 3786713 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3786715 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 3786726 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 3786726 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 3786727 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/cores
   [junit4]   2> 3786727 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 3786728 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/cores/collection1
   [junit4]   2> 3786728 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 3786729 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 3786729 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 3786729 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 3786729 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 3786730 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:44714/g_m/xa",
   [junit4]   2>   "node_name":"127.0.0.1:44714_g_m%2Fxa",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 3786731 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 3786731 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:44714/g_m/xa",
   [junit4]   2>   "node_name":"127.0.0.1:44714_g_m%2Fxa",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 3786732 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 3786732 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 3786733 INFO  (zkCallback-4046-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3787731 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3787732 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 3787732 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 3787732 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 3787733 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 3787733 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/cores/collection1'
   [junit4]   2> 3787733 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3787734 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3787735 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 3787743 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 3787747 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 3787757 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3787763 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 3787864 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3787870 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 3787872 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 3787881 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 3787883 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 3787885 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3787886 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3787888 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 3787888 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 3787888 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 3787889 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:40370/solr_hdfs_home
   [junit4]   2> 3787889 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 3787889 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/control-001/cores/collection1], dataDir=[hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 3787889 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@38cecabe
   [junit4]   2> 3787889 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 3787907 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 3787908 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 3787918 WARN  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:40370/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3787918 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 3787925 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 3787925 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 3787930 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 3787930 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 3787931 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=76.97265625, floorSegmentMB=1.4580078125, forceMergeDeletesPctAllowed=13.615608956911618, segmentsPerTier=12.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8813590336742532
   [junit4]   2> 3787950 INFO  (IPC Server handler 0 on 40370) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:54453 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f2049002-05ca-4bf7-8dd9-b08399cf248d:NORMAL:127.0.0.1:49698|RBW], ReplicaUnderConstruction[[DISK]DS-f9810188-0ecd-4333-8cfb-02f856bfe153:NORMAL:127.0.0.1:54453|RBW]]} size 0
   [junit4]   2> 3787955 INFO  (IPC Server handler 1 on 40370) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:49698 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-f2049002-05ca-4bf7-8dd9-b08399cf248d:NORMAL:127.0.0.1:49698|RBW], ReplicaUnderConstruction[[DISK]DS-f9810188-0ecd-4333-8cfb-02f856bfe153:NORMAL:127.0.0.1:54453|RBW]]} size 0
   [junit4]   2> 3787960 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1cdfb9a8); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 3787960 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 3787962 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 3787965 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3787965 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3787965 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3787965 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3787965 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3787966 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3787966 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3787966 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3787966 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3787966 WARN  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 3787968 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3787969 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3787971 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3787972 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 3787976 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 3787976 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 3787977 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 3787977 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 tlogDfsReplication=2
   [junit4]   2> 3787988 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 3787989 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 3787990 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=68.5771484375, floorSegmentMB=1.3447265625, forceMergeDeletesPctAllowed=27.042426296031806, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8181578963699278
   [junit4]   2> 3788002 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:40370/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1cdfb9a8); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 3788002 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 3788003 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1763b458[collection1] main]
   [junit4]   2> 3788003 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 3788004 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 3788004 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3788005 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3788005 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 3788005 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3788006 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3788006 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3788006 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 3788006 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 3788008 INFO  (searcherExecutor-8002-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1763b458[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 3788008 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 3788008 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 3788008 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 3788008 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1526732120233345024
   [junit4]   2> 3788008 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 0.0ms to seed version buckets with highest version 1526732120233345024
   [junit4]   2> 3788008 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 3788009 INFO  (coreLoadExecutor-8001-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 3788010 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:44714/g_m/xa collection:control_collection shard:shard1
   [junit4]   2> 3788012 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 3788015 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95420757411627012-core_node1-n_0000000000
   [junit4]   2> 3788015 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 3788017 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 3788017 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 3788017 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 3788018 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44714/g_m/xa/collection1/
   [junit4]   2> 3788018 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 3788018 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:44714/g_m/xa/collection1/ has no replicas
   [junit4]   2> 3788018 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 3788021 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95420757411627012-core_node1-n_0000000000
   [junit4]   2> 3788024 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44714/g_m/xa/collection1/ shard1
   [junit4]   2> 3788024 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:44714/g_m/xa",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 3788126 INFO  (zkCallback-4046-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3788175 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:44714/g_m/xa/collection1/ and leader is http://127.0.0.1:44714/g_m/xa/collection1/
   [junit4]   2> 3788176 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44714/g_m/xa
   [junit4]   2> 3788176 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 3788176 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 3788176 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 3788178 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:44714/g_m/xa",
   [junit4]   2>   "node_name":"127.0.0.1:44714_g_m%2Fxa",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 3788178 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:44714/g_m/xa",
   [junit4]   2>   "node_name":"127.0.0.1:44714_g_m%2Fxa",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 3788178 INFO  (coreZkRegister-7995-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:44714_g_m%2Fxa c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 3788231 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3788232 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3788232 INFO  (zkCallback-4048-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@700c2298 name:ZooKeeperConnection Watcher:127.0.0.1:36610/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3788233 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3788233 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3788233 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3788234 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3788235 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 3788235 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 3788235 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3788235 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3788236 INFO  (zkCallback-4049-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@31dd87a1 name:ZooKeeperConnection Watcher:127.0.0.1:36610/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3788236 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3788236 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3788238 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 3788238 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 3788239 INFO  (zkCallback-4046-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3788239 INFO  (zkCallback-4048-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3788338 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/cores/collection1
   [junit4]   2> 3788339 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001
   [junit4]   2> 3788339 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 3788341 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@50bab8af{/g_m/xa,null,AVAILABLE}
   [junit4]   2> 3788341 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@26968d40{HTTP/1.1,[http/1.1]}{127.0.0.1:56655}
   [junit4]   2> 3788342 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.e.j.s.Server Started @3791924ms
   [junit4]   2> 3788342 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:40370/hdfs__localhost_40370__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/g_m/xa, hostPort=56655, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/cores}
   [junit4]   2> 3788342 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 3788343 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001'
   [junit4]   2> 3788343 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3788343 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3788343 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3788344 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3788344 INFO  (zkCallback-4050-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4f310526 name:ZooKeeperConnection Watcher:127.0.0.1:36610/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3788345 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3788345 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3788346 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 3788346 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/solr.xml
   [junit4]   2> 3788348 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 3788351 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/cores
   [junit4]   2> 3788351 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CoreContainer New CoreContainer 1096845708
   [junit4]   2> 3788351 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001]
   [junit4]   2> 3788352 WARN  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/lib
   [junit4]   2> 3788352 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 3788353 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 3788353 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3788353 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3788354 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36610/solr
   [junit4]   2> 3788354 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 3788354 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3788354 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3788355 INFO  (zkCallback-4053-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@149ac821 name:ZooKeeperConnection Watcher:127.0.0.1:36610 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3788355 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3788355 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3788357 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3788357 INFO  (zkCallback-4054-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@638dcba1 name:ZooKeeperConnection Watcher:127.0.0.1:36610/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3788357 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3788362 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 3788363 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 3789367 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56655_g_m%2Fxa
   [junit4]   2> 3789367 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56655_g_m%2Fxa
   [junit4]   2> 3789368 INFO  (zkCallback-4046-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3789368 INFO  (zkCallback-4054-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3789368 INFO  (zkCallback-4048-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3789369 INFO  (zkCallback-4046-thread-1-processing-n:127.0.0.1:44714_g_m%2Fxa) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3789369 INFO  (zkCallback-4054-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3789369 INFO  (zkCallback-4048-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 3789370 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3789370 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95420757411627017-127.0.0.1:56655_g_m%2Fxa-n_0000000001
   [junit4]   2> 3789371 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000 to know if I could be the leader
   [junit4]   2> 3789396 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 3789396 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 3789396 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/cores
   [junit4]   2> 3789397 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 3789397 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsUnloadDistributedZkTest_743680B31E0433AB-001/shard-1-001/cores/collection1
   [junit4]   2> 3789397 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 3789398 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 3789398 INFO  (TEST-HdfsUnloadDistributedZkTest.test-seed#[743680B31E0433AB]) [n:127.0.0.1:56655_g_m%2Fxa    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 3789398 INFO  (coreLoadExecutor-8012-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 3789399 INFO  (coreLoadExecutor-8012-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 3789400 INFO  (coreLoadExecutor-8012-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 3789400 INFO  (coreLoadExecutor-8012-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
   [junit4]   2> 3789400 INFO  (OverseerStateUpdate-95420757411627012-127.0.0.1:44714_g_m%2Fxa-n_0000000000) [n:127.0.0.1:44714_g_m%2Fxa    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:56655/g_m/xa",
   [junit4]   2>   "node_name":"127.0.0.1:56655_g_m%2Fxa",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 3789400 INFO  (coreLoadExecutor-8012-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for [collection1] ver [0]
   [junit4]   2> 3789400 INFO  (coreLoadExecutor-8012-thread-1-processing-n:127.0.0.1:56655_g_m%2Fxa) [n:127.0.0.1:56655_g_m%2Fxa c:collection1   x:collection1] o.a.

[...truncated too long message...]

tMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsUnloadDistributedZkTest.teardownClass(HdfsUnloadDistributedZkTest.java:46)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 54 more
   [junit4]   2> 3955431 INFO  (SUITE-HdfsUnloadDistributedZkTest-seed#[743680B31E0433AB]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Feb 20, 2016 9:56:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {other_tl1=FST50, range_facet_l_dv=FSTOrd50, _version_=FST50, multiDefault=PostingsFormat(name=Asserting), a_t=FST50, intDefault=FST50, a_i1=FST50, id=FSTOrd50, range_facet_i_dv=FST50, text=PostingsFormat(name=MockRandom), range_facet_l=FST50, timestamp=FST50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=es-US, timezone=America/Belize
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=2,free=207742216,total=526385152
   [junit4]   2> NOTE: All tests run in this JVM: [TestTestInjection, TestRequestStatusCollectionAPI, TestUseDocValuesAsStored, JSONWriterTest, SignatureUpdateProcessorFactoryTest, TestAnalyzedSuggestions, AnalysisAfterCoreReloadTest, CacheHeaderTest, TestExactSharedStatsCache, OverriddenZkACLAndCredentialsProvidersTest, TestFieldResource, LeaderFailoverAfterPartitionTest, TestStressLucene, AddBlockUpdateTest, DisMaxRequestHandlerTest, URLClassifyProcessorTest, SuggestComponentContextFilterQueryTest, UUIDFieldTest, DefaultValueUpdateProcessorTest, HdfsChaosMonkeySafeLeaderTest, RemoteQueryErrorTest, LeaderElectionIntegrationTest, ActionThrottleTest, AsyncCallRequestStatusResponseTest, SyncSliceTest, DistributedQueryElevationComponentTest, RollingRestartTest, TestQueryWrapperFilter, TestHighFrequencyDictionaryFactory, TestLRUCache, ResourceLoaderTest, TestCSVLoader, TestCollectionAPI, SynonymTokenizerTest, DeleteShardTest, DistributedFacetPivotLongTailTest, HdfsRecoverLeaseTest, TestComponentsName, TestFastOutputStream, TestCrossCoreJoin, TestAuthenticationFramework, TestDownShardTolerantSearch, TestNRTOpen, TestHashQParserPlugin, TestFaceting, BufferStoreTest, BasicDistributedZkTest, ExternalFileFieldSortTest, TestHdfsUpdateLog, ResponseHeaderTest, SOLR749Test, TestFoldingMultitermQuery, TestValueSourceCache, TestMergePolicyConfig, DataDrivenBlockJoinTest, ConnectionReuseTest, DistributedSpellCheckComponentTest, OverseerStatusTest, PrimUtilsTest, TestRebalanceLeaders, TestManagedResourceStorage, TestRandomDVFaceting, HdfsSyncSliceTest, IndexSchemaTest, HLLSerializationTest, TestReplicationHandler, TestPKIAuthenticationPlugin, TestBadConfig, TestRangeQuery, TestIntervalFaceting, ZkNodePropsTest, PeerSyncTest, TestSolrQueryResponse, CdcrReplicationDistributedZkTest, QueryResultKeyTest, TestLeaderInitiatedRecoveryThread, BasicAuthIntegrationTest, CheckHdfsIndexTest, DistributedVersionInfoTest, BlockJoinFacetSimpleTest, TestMinMaxOnMultiValuedField, ChangedSchemaMergeTest, CollectionTooManyReplicasTest, TestHighlightDedupGrouping, TestBlendedInfixSuggestions, EnumFieldTest, TestSolrQueryParserDefaultOperatorResource, OutputWriterTest, InfoHandlerTest, TestDynamicFieldCollectionResource, SolrCoreTest, HdfsUnloadDistributedZkTest]
   [junit4] Completed [457/579 (1!)] on J0 in 180.38s, 1 test, 1 error <<< FAILURES!

[...truncated 387 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:524: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1014: There were test failures: 579 suites (8 ignored), 2331 tests, 1 error, 34 ignored (18 assumptions) [seed: 743680B31E0433AB]

Total time: 200 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message