lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-6.x - Build # 102 - Still Failing
Date Sun, 26 Jun 2016 19:37:31 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/102/

2 tests failed.
FAILED:  org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest.test

Error Message:
document count mismatch.  control=9806 sum(shards)=9810 cloudClient=9810

Stack Trace:
java.lang.AssertionError: document count mismatch.  control=9806 sum(shards)=9810 cloudClient=9810
	at __randomizedtesting.SeedInfo.seed([846E908F1F1D281B:C3AAF55B1E145E3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1323)
	at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:228)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=206595, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=206595, name=collection5, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:58594/gitn/n: collection already exists: awholynewstresscollection_collection5_3
	at __randomizedtesting.SeedInfo.seed([846E908F1F1D281B]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:403)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:356)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1228)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:998)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:934)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1599)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1620)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:987)




Build Log:
[...truncated 12663 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/init-core-data-001
   [junit4]   2> 4060684 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 4060684 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_ur/y
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4060731 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4060738 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4060740 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4060749 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_44105_hdfs____fz6asg/webapp
   [junit4]   2> 4061050 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44105
   [junit4]   2> 4061140 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4061141 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4061153 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37490_datanode____r5ymz2/webapp
   [junit4]   2> 4061568 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37490
   [junit4]   2> 4061648 WARN  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4061648 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4061657 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_55557_datanode____.su54ma/webapp
   [junit4]   2> 4061702 INFO  (IPC Server handler 3 on 41362) [    ] BlockStateChange BLOCK* processReport: from storage DS-bcb75f09-45bf-4282-8c10-82091af374ee node DatanodeRegistration(127.0.0.1:44537, datanodeUuid=08231ddd-1312-4df7-a24b-6339432c6f63, infoPort=58362, infoSecurePort=0, ipcPort=33447, storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 4061703 INFO  (IPC Server handler 3 on 41362) [    ] BlockStateChange BLOCK* processReport: from storage DS-217c13fb-bda2-4aaa-adc2-878d3ebdedf5 node DatanodeRegistration(127.0.0.1:44537, datanodeUuid=08231ddd-1312-4df7-a24b-6339432c6f63, infoPort=58362, infoSecurePort=0, ipcPort=33447, storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, hasStaleStorage: false, processing time: 1 msecs
   [junit4]   2> 4062052 INFO  (SUITE-HdfsChaosMonkeyNothingIsSafeTest-seed#[846E908F1F1D281B]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:55557
   [junit4]   2> 4062131 INFO  (IPC Server handler 2 on 41362) [    ] BlockStateChange BLOCK* processReport: from storage DS-cf252536-d004-484c-b21a-14ea4e56d740 node DatanodeRegistration(127.0.0.1:56172, datanodeUuid=4a22ecca-fa6e-406a-9393-d319c0faa40e, infoPort=56408, infoSecurePort=0, ipcPort=38987, storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 4062131 INFO  (IPC Server handler 2 on 41362) [    ] BlockStateChange BLOCK* processReport: from storage DS-f2d8fec2-a1aa-4ea3-b8ea-e430289b3126 node DatanodeRegistration(127.0.0.1:56172, datanodeUuid=4a22ecca-fa6e-406a-9393-d319c0faa40e, infoPort=56408, infoSecurePort=0, ipcPort=38987, storageInfo=lv=-56;cid=testClusterID;nsid=2073100279;c=0), blocks: 0, hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 4062213 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4062213 INFO  (Thread-65688) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4062213 INFO  (Thread-65688) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4062313 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.ZkTestServer start zk server on port:34604
   [junit4]   2> 4062313 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062313 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062316 INFO  (zkCallback-29608-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40dbe2a2 name:ZooKeeperConnection Watcher:127.0.0.1:34604 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062316 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062316 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062316 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4062320 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062320 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062321 INFO  (zkCallback-29609-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@22684b6c name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062321 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062321 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062321 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 4062322 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 4062323 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 4062324 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 4062325 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 4062325 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 4062326 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 4062326 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 4062327 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4062327 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4062328 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 4062328 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 4062329 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 4062329 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 4062330 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 4062330 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 4062331 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4062331 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 4062332 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4062332 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4062333 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4062333 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4062334 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4062334 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 4062334 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 4062335 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4062400 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1
   [junit4]   2> 4062401 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 4062402 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8f55469{/_ur/y,null,AVAILABLE}
   [junit4]   2> 4062403 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@6eadff4{HTTP/1.1,[http/1.1]}{127.0.0.1:38122}
   [junit4]   2> 4062403 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.Server Started @4066260ms
   [junit4]   2> 4062403 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:41362/hdfs__localhost_41362__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001_tempDir-002_control_data, hostContext=/_ur/y, hostPort=38122, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores}
   [junit4]   2> 4062403 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 4062403 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001'
   [junit4]   2> 4062403 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4062403 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 4062404 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062404 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062405 INFO  (zkCallback-29610-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@238704a2 name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062405 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062406 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062406 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 4062406 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/solr.xml
   [junit4]   2> 4062410 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores
   [junit4]   2> 4062410 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CoreContainer New CoreContainer 241842919
   [junit4]   2> 4062410 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001]
   [junit4]   2> 4062410 WARN  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/lib
   [junit4]   2> 4062411 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4062411 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4062412 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4062412 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4062412 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34604/solr
   [junit4]   2> 4062412 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4062412 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4062412 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062413 INFO  (zkCallback-29613-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@24b432a4 name:ZooKeeperConnection Watcher:127.0.0.1:34604 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062413 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062414 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4062414 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$31/1456695046@23a20e6c
   [junit4]   2> 4062415 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4062415 INFO  (zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32e7fbeb name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4062415 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4062416 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 4062417 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 4062419 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 4062420 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 4062421 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 4062422 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4062423 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4062423 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4062424 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4062424 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4062425 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 4062425 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4062426 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 4062427 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 4062427 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4062428 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000
   [junit4]   2> 4062428 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38122__ur%2Fy
   [junit4]   2> 4062428 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 4062429 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer Overseer (id=96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) starting
   [junit4]   2> 4062430 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 4062433 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 4062433 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 4062433 INFO  (OverseerCollectionConfigSetProcessor-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 4062433 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38122__ur%2Fy
   [junit4]   2> 4062434 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:38122__ur%2Fy
   [junit4]   2> 4062434 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 4062435 INFO  (zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 4062442 INFO  (zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4062452 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 4062452 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 4062452 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores
   [junit4]   2> 4062453 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 4062453 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1
   [junit4]   2> 4062453 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 4062454 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 4062454 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0
   [junit4]   2> 4062454 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 4062454 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 4062454 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController Collection control_collection not visible yet, but flagging it so a watch is registered when it becomes visible
   [junit4]   2> 4062455 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y",
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 4062455 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y",
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 4062455 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 4062455 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 4062456 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 4062456 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 4062456 INFO  (zkCallback-29614-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4063456 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4063456 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 4063456 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 4063456 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 4063457 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 4063457 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1'
   [junit4]   2> 4063457 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4063457 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 4063460 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 4063465 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4063467 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.2.0
   [junit4]   2> 4063479 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4063482 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 4063612 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 4063613 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4063613 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4063635 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4063661 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0
   [junit4]   2> 4063661 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 4063661 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 4063661 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:41362/solr_hdfs_home
   [junit4]   2> 4063662 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4063662 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/control-001/cores/collection1], dataDir=[hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 4063662 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@207b145c
   [junit4]   2> 4063662 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4063789 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4063790 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 4063806 WARN  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 4063806 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4063812 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 4063812 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 4063812 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 4063823 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 4063823 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4063824 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@690664ab
   [junit4]   2> 4063887 INFO  (IPC Server handler 1 on 41362) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:44537 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-cf252536-d004-484c-b21a-14ea4e56d740:NORMAL:127.0.0.1:56172|RBW], ReplicaUC[[DISK]DS-bcb75f09-45bf-4282-8c10-82091af374ee:NORMAL:127.0.0.1:44537|FINALIZED]]} size 0
   [junit4]   2> 4063888 INFO  (IPC Server handler 2 on 41362) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:56172 is added to blk_1073741825_1001{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-cf252536-d004-484c-b21a-14ea4e56d740:NORMAL:127.0.0.1:56172|RBW], ReplicaUC[[DISK]DS-bcb75f09-45bf-4282-8c10-82091af374ee:NORMAL:127.0.0.1:44537|FINALIZED]]} size 0
   [junit4]   2> 4063891 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26503395); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4063891 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4063892 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4063894 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4063895 WARN  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 4063896 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063897 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063897 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063898 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4063900 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/dump,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 4063900 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4063900 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 4063900 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 4063900 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 4063906 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 4063907 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4063907 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=94.88671875, floorSegmentMB=0.82421875, forceMergeDeletesPctAllowed=17.85003723179897, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 4063917 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26503395); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4063917 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4063917 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@50fb330[collection1] main]
   [junit4]   2> 4063918 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 4063918 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 4063918 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 4063919 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 4063919 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 4063919 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4063919 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4063919 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4063920 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 4063920 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4063922 INFO  (searcherExecutor-14369-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@50fb330[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4063922 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 4063923 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 4063923 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 4063923 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1538227861207384064
   [junit4]   2> 4063925 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1538227861207384064
   [junit4]   2> 4063925 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 4063926 INFO  (coreLoadExecutor-14368-thread-1-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 4063928 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:38122/_ur/y collection:control_collection shard:shard1
   [junit4]   2> 4063928 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 4063930 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/96139241213460484-core_node1-n_0000000000
   [junit4]   2> 4063930 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 4063931 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 4063931 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 4063931 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38122/_ur/y/collection1/
   [junit4]   2> 4063931 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 4063931 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 4063931 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:38122/_ur/y/collection1/ has no replicas
   [junit4]   2> 4063932 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 4063933 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/96139241213460484-core_node1-n_0000000000
   [junit4]   2> 4063934 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38122/_ur/y/collection1/ shard1
   [junit4]   2> 4063934 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 4063955 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.s.i.CloudSolrClient Final constructed zkHost string: 127.0.0.1:34604/solr
   [junit4]   2> 4063956 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4063956 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4063956 INFO  (zkCallback-29618-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6d2ac458 name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4063957 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4063957 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4063957 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4063957 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 4063957 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4063958 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 4064017 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/cores/collection1
   [junit4]   2> 4064017 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001
   [junit4]   2> 4064018 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 4064019 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@12372532{/_ur/y,null,AVAILABLE}
   [junit4]   2> 4064020 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@8d8bfb5{HTTP/1.1,[http/1.1]}{127.0.0.1:35908}
   [junit4]   2> 4064021 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.e.j.s.Server Started @4067878ms
   [junit4]   2> 4064021 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=hdfs://localhost:41362/hdfs__localhost_41362__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_solr_build_solr-core_test_J0_temp_solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001_tempDir-002_jetty1, solrconfig=solrconfig.xml, hostContext=/_ur/y, hostPort=35908, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/cores}
   [junit4]   2> 4064021 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 4064021 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001'
   [junit4]   2> 4064022 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4064022 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 4064022 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4064023 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4064023 INFO  (zkCallback-29619-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3652a6ef name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4064023 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4064024 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4064025 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 4064025 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/solr.xml
   [junit4]   2> 4064028 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/cores
   [junit4]   2> 4064028 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CoreContainer New CoreContainer 214033527
   [junit4]   2> 4064028 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001]
   [junit4]   2> 4064029 WARN  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.hdfs.HdfsChaosMonkeyNothingIsSafeTest_846E908F1F1D281B-001/shard-1-001/lib
   [junit4]   2> 4064029 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4064030 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4064030 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4064030 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4064030 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34604/solr
   [junit4]   2> 4064030 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4064030 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4064031 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4064032 INFO  (zkCallback-29622-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@214ba213 name:ZooKeeperConnection Watcher:127.0.0.1:34604 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4064032 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4064032 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4064033 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$31/1456695046@692aa909
   [junit4]   2> 4064033 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4064034 INFO  (zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11050654 name:ZooKeeperConnection Watcher:127.0.0.1:34604/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4064034 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4064035 INFO  (zkCallback-29614-thread-2-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4064035 INFO  (zkCallback-29618-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4064039 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4064040 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 4064040 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4064041 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4064041 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96139241213460488-127.0.0.1:35908__ur%2Fy-n_0000000001
   [junit4]   2> 4064042 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000 to know if I could be the leader
   [junit4]   2> 4064042 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.ZkController Publish node=127.0.0.1:35908__ur%2Fy as DOWN
   [junit4]   2> 4064043 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:35908__ur%2Fy"} current state version: 2
   [junit4]   2> 4064043 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:35908__ur%2Fy
   [junit4]   2> 4064084 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:38122/_ur/y/collection1/ and leader is http://127.0.0.1:38122/_ur/y/collection1/
   [junit4]   2> 4064084 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38122/_ur/y
   [junit4]   2> 4064085 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 4064085 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 4064085 INFO  (coreZkRegister-14362-thread-1-processing-n:127.0.0.1:38122__ur%2Fy x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:38122__ur%2Fy c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 4064086 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "dataDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y",
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "ulogDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/tlog"} current state version: 2
   [junit4]   2> 4064087 INFO  (OverseerStateUpdate-96139241213460484-127.0.0.1:38122__ur%2Fy-n_0000000000) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.o.ReplicaMutator Update state numShards=4 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "dataDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:38122/_ur/y",
   [junit4]   2>   "node_name":"127.0.0.1:38122__ur%2Fy",
   [junit4]   2>   "numShards":"4",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "ulogDir":"hdfs://localhost:41362/solr_hdfs_home/control_collection/core_node1/data/tlog"}
   [junit4]   2> 4064189 INFO  (zkCallback-29618-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4064189 INFO  (zkCallback-29614-thread-2-processing-n:127.0.0.1:38122__ur%2Fy) [n:127.0.0.1:38122__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4064189 INFO  (zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4065043 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35908__ur%2Fy
   [junit4]   2> 4065044 INFO  (TEST-HdfsChaosMonkeyNothingIsSafeTest.test-seed#[846E908F1F1D281B]) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35908__ur%2Fy
   [junit4]   2> 4065044 INFO  (zkCallback-29618-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4065044 INFO  (zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4065045 INFO  (zkCallback-29623-thread-1-processing-n:127.0.0.1:35908__ur%2Fy) [n:127.0.0.1:35908__ur%2Fy    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper

[...truncated too long message...]

odAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729)
   [junit4]   2> 	... 54 more
   [junit4]   2> 4959295 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[846E908F1F1D281B]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Jun 26, 2016 7:28:19 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 34 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {other_tl1=BlockTreeOrds(blocksize=128), range_facet_l_dv=Lucene50(blocksize=128), _version_=BlockTreeOrds(blocksize=128), multiDefault=FST50, a_t=FST50, intDefault=BlockTreeOrds(blocksize=128), a_i1=FST50, id=Lucene50(blocksize=128), range_facet_i_dv=FST50, text=Lucene50(blocksize=128), range_facet_l=FST50, timestamp=FST50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=317, maxMBSortInHeap=6.749882700199259, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=zh-HK, timezone=MET
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=76119152,total=469237760
   [junit4]   2> NOTE: All tests run in this JVM: [TestSchemaManager, TestCloudBackupRestore, HdfsChaosMonkeySafeLeaderTest, CdcrVersionReplicationTest, DeleteStatusTest, TestHighFrequencyDictionaryFactory, TestBadConfig, RAMDirectoryFactoryTest, TestSortingResponseWriter, TestArbitraryIndexDir, TestConfig, TestPivotHelperCode, TestRecoveryHdfs, CloudExitableDirectoryReaderTest, DocExpirationUpdateProcessorFactoryTest, LeaderInitiatedRecoveryOnCommitTest, PreAnalyzedFieldTest, JsonLoaderTest, TestRangeQuery, SyncSliceTest, MergeStrategyTest, SolrRequestParserTest, PrimUtilsTest, DistributedFacetPivotSmallAdvancedTest, TestFunctionQuery, TestIBSimilarityFactory, IndexSchemaTest, TestDistribDocBasedVersion, BasicDistributedZkTest, ResourceLoaderTest, CollectionTooManyReplicasTest, DefaultValueUpdateProcessorTest, CurrencyFieldOpenExchangeTest, TestRebalanceLeaders, TestSubQueryTransformerCrossCore, CopyFieldTest, TestSizeLimitedDistributedMap, TestSolrFieldCacheMBean, TestScoreJoinQPScore, TestCSVLoader, BigEndianAscendingWordDeserializerTest, PolyFieldTest, DistributedExpandComponentTest, TestFaceting, AnalysisAfterCoreReloadTest, TestStressLiveNodes, TestAtomicUpdateErrorCases, OutputWriterTest, ReplicationFactorTest, TestSchemaVersionResource, TestFastOutputStream, DateFieldTest, ForceLeaderTest, TestLazyCores, ConcurrentDeleteAndCreateCollectionTest, TestDistributedSearch, HdfsRecoverLeaseTest, XsltUpdateRequestHandlerTest, EnumFieldTest, CreateCollectionCleanupTest, BlockJoinFacetSimpleTest, TestNonDefinedSimilarityFactory, CheckHdfsIndexTest, TestRemoteStreaming, PathHierarchyTokenizerFactoryTest, TestLMDirichletSimilarityFactory, TestLeaderElectionZkExpiry, SimpleMLTQParserTest, TestMiniSolrCloudClusterSSL, BlobRepositoryCloudTest, TestRealTimeGet, TestFilteredDocIdSet, DistributedQueryComponentCustomSortTest, TestCollationFieldDocValues, TestPseudoReturnFields, TestAnalyzedSuggestions, FileBasedSpellCheckerTest, TestAddFieldRealTimeGet, AlternateDirectoryTest, TestCustomDocTransformer, TestDynamicFieldCollectionResource, DeleteLastCustomShardedReplicaTest, HdfsBasicDistributedZk2Test, ExternalFileFieldSortTest, HLLUtilTest, PingRequestHandlerTest, TestSimpleQParserPlugin, AtomicUpdatesTest, TestReplicationHandler, TestDynamicLoading, TestStressLucene, TestSchemaNameResource, BasicAuthIntegrationTest, TestConfigSetsAPIExclusivity, SuggestComponentTest, TestRTimerTree, TestRandomFaceting, TestFieldResource, AsyncCallRequestStatusResponseTest, TestJoin, TestDocTermOrds, UnloadDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, FullSolrCloudDistribCmdsTest, LeaderElectionTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, ShardRoutingCustomTest, TestHashPartitioner, DistributedSpellCheckComponentTest, TestStressReorder, TestReload, TestStressVersions, HardAutoCommitTest, SimpleFacetsTest, TestSolr4Spatial, StatsComponentTest, ConvertedLegacyTest, TestSort, DirectUpdateHandlerTest, SoftAutoCommitTest, TestExtendedDismaxParser, CoreAdminHandlerTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestUpdate, QueryEqualityTest, TestSolrDeletionPolicy1, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DocumentAnalysisRequestHandlerTest, TermsComponentTest, TestValueSourceCache, MoreLikeThisHandlerTest, FastVectorHighlighterTest, RegexBoostProcessorTest, TestJmxIntegration, JSONWriterTest, MBeansHandlerTest, TestPHPSerializedResponseWriter, TestComponentsName, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, ResponseLogComponentTest, BadComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, TestDocSet, TestBinaryField, MinimalSchemaTest, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, TestPhraseSuggestions, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestFastWriter, URLClassifyProcessorTest, PluginInfoTest, TestSolrJ, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [489/617 (2!)] on J0 in 733.14s, 1 test, 1 error <<< FAILURES!

[...truncated 405 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:530: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1427: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:984: There were test failures: 617 suites (10 ignored), 2597 tests, 1 error, 1 failure, 32 ignored (17 assumptions) [seed: 846E908F1F1D281B]

Total time: 291 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




Mime
View raw message