lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 1072 - Still Failing
Date Mon, 11 Jan 2016 13:27:56 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/1072/

2 tests failed.
FAILED:  org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig

Error Message:
The max direct memory is likely too low.  Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.

Stack Trace:
java.lang.RuntimeException: The max direct memory is likely too low.  Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
	at __randomizedtesting.SeedInfo.seed([8F089C32D5F6338D:78A75519287FD9A6]:0)
	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:296)
	at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:272)
	at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:213)
	at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:114)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
	at java.nio.Bits.reserveMemory(Bits.java:658)
	at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
	at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:306)
	at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:64)
	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:294)
	... 42 more


FAILED:  org.apache.solr.index.hdfs.CheckHdfsIndexTest.doTest

Error Message:
Could not find a healthy node to handle the request.

Stack Trace:
org.apache.solr.common.SolrException: Could not find a healthy node to handle the request.
	at __randomizedtesting.SeedInfo.seed([8F089C32D5F6338D:284C2496B84D2034]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1085)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:483)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:464)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.commit(AbstractFullDistribZkTestBase.java:1505)
	at org.apache.solr.index.hdfs.CheckHdfsIndexTest.doTest(CheckHdfsIndexTest.java:101)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10830 lines...]
   [junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/heapdumps/java_pid21414.hprof ...
   [junit4] Heap dump file created [609670035 bytes in 5.932 secs]
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] <<< JVM J1: EOF ----

[...truncated 602 lines...]
   [junit4] Suite: org.apache.solr.core.HdfsDirectoryFactoryTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/init-core-data-001
   [junit4]   2> 4173609 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4173644 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4173650 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4173652 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4173666 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_53663_hdfs____.sab96p/webapp
   [junit4]   2> 4173781 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4173943 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53663
   [junit4]   2> 4173998 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4173999 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4174016 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_36910_datanode____e2cc3g/webapp
   [junit4]   2> 4174133 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4174341 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36910
   [junit4]   2> 4174371 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4174373 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4174386 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41924_datanode____.k4zgcb/webapp
   [junit4]   2> 4174411 INFO  (IPC Server handler 3 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-6acc99d6-5839-4162-bd2d-c8063b375e41 node DatanodeRegistration(127.0.0.1, datanodeUuid=10416d2b-5638-40bc-a743-3ecf129c4740, infoPort=36910, ipcPort=39544, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4174411 INFO  (IPC Server handler 3 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-9bcd3ee7-a123-4e9a-bf10-ffe94cbbdf2d node DatanodeRegistration(127.0.0.1, datanodeUuid=10416d2b-5638-40bc-a743-3ecf129c4740, infoPort=36910, ipcPort=39544, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4174509 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4174715 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41924
   [junit4]   2> 4174787 INFO  (IPC Server handler 8 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-9ab7abe7-74aa-41c0-a006-f29ef21d5d03 node DatanodeRegistration(127.0.0.1, datanodeUuid=12802cc4-6db1-4ef5-8642-74a794f9f7e4, infoPort=41924, ipcPort=46508, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4174787 INFO  (IPC Server handler 8 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-0ae8619b-5584-4676-91c1-ab5b358cf654 node DatanodeRegistration(127.0.0.1, datanodeUuid=12802cc4-6db1-4ef5-8642-74a794f9f7e4, infoPort=41924, ipcPort=46508, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCleanupOldIndexDirectories
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr1
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 705101462
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {configSetProperties=configsetprops.json, transient=false, schema=schema.xml, name=mock, config=solrconfig.xml, loadOnStartup=true, dataDir=data/}
   [junit4]   2> 4174900 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Deleted old index directory hdfs://localhost:58558/solr1/mock/data/index.20160111141101588
   [junit4]   2> 4174901 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCleanupOldIndexDirectories
   [junit4]   2> 4174938 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLocalityReporter
   [junit4]   2> 4174947 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr
   [junit4]   2> 4174948 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4174948 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58558/solr3/
   [junit4]   2> 4174960 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:58558/solr3 for locality metrics.
   [junit4]   2> 4174971 INFO  (IPC Server handler 1 on 58558) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38183 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bcd3ee7-a123-4e9a-bf10-ffe94cbbdf2d:NORMAL:127.0.0.1:52681|RBW], ReplicaUnderConstruction[[DISK]DS-9ab7abe7-74aa-41c0-a006-f29ef21d5d03:NORMAL:127.0.0.1:38183|RBW]]} size 0
   [junit4]   2> 4174971 INFO  (IPC Server handler 2 on 58558) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52681 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bcd3ee7-a123-4e9a-bf10-ffe94cbbdf2d:NORMAL:127.0.0.1:52681|RBW], ReplicaUnderConstruction[[DISK]DS-9ab7abe7-74aa-41c0-a006-f29ef21d5d03:NORMAL:127.0.0.1:38183|RBW]]} size 0
   [junit4]   2> 4174976 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CachingDirectoryFactory Closing HdfsDirectoryFactory - 0 directories currently being tracked
   [junit4]   2> 4174976 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLocalityReporter
   [junit4]   2> 4175014 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testInitArgsOrSysPropConfig
   [junit4]   2> 4175014 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr1
   [junit4]   2> 4175014 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1804671906
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {configSetProperties=configsetprops.json, transient=false, schema=schema.xml, name=mock, loadOnStartup=true, config=solrconfig.xml, dataDir=data/}
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr2
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 61693914
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {config=solrconfig.xml, configSetProperties=configsetprops.json, schema=schema.xml, transient=false, dataDir=data/, loadOnStartup=true, name=mock}
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr2
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1802494744
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {loadOnStartup=true, configSetProperties=configsetprops.json, config=solrconfig.xml, schema=schema.xml, name=mock, transient=false, dataDir=data/}
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58558/solr
   [junit4]   2> 4175028 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 4175028 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [134217728] will allocate [1] slabs and use ~[134217728] bytes
   [junit4]   2> 4175028 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 4175613 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1802494744
   [junit4]   2> 4175614 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=61693914
   [junit4]   2> 4175614 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1804671906
   [junit4]   2> 4175614 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=705101462
   [junit4]   2> 4175708 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testInitArgsOrSysPropConfig
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HdfsDirectoryFactoryTest -Dtests.method=testInitArgsOrSysPropConfig -Dtests.seed=8F089C32D5F6338D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=lt -Dtests.timezone=Europe/Belgrade -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.73s J2 | HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: The max direct memory is likely too low.  Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8F089C32D5F6338D:78A75519287FD9A6]:0)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:296)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:272)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:213)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:114)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Direct buffer memory
   [junit4]    > 	at java.nio.Bits.reserveMemory(Bits.java:658)
   [junit4]    > 	at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
   [junit4]    > 	at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:306)
   [junit4]    > 	at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:64)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:294)
   [junit4]    > 	... 42 more
   [junit4]   2> 4175712 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 4175718 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 4175721 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 12802cc4-6db1-4ef5-8642-74a794f9f7e4) service to localhost/127.0.0.1:58558 interrupted
   [junit4]   2> 4175721 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 12802cc4-6db1-4ef5-8642-74a794f9f7e4) service to localhost/127.0.0.1:58558
   [junit4]   2> 4175724 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 4175728 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 4175830 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 10416d2b-5638-40bc-a743-3ecf129c4740) service to localhost/127.0.0.1:58558 interrupted
   [junit4]   2> 4175830 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 10416d2b-5638-40bc-a743-3ecf129c4740) service to localhost/127.0.0.1:58558
   [junit4]   2> 4175838 WARN  (org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@9d3a9f1) [    ] o.a.h.h.s.b.DecommissionManager Monitor interrupted: java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 4175850 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 4175952 ERROR (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
   [junit4]   2> java.lang.reflect.InvocationTargetException
   [junit4]   2> 	at sun.reflect.GeneratedMethodAccessor136.invoke(Unknown Source)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:199)
   [junit4]   2> 	at org.apache.solr.core.HdfsDirectoryFactoryTest.teardownClass(HdfsDirectoryFactoryTest.java:67)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 4175956 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001
   [junit4]   2> Jan 11, 2016 1:11:02 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=lt, timezone=Europe/Belgrade
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=2,free=395209656,total=520617984
   [junit4]   2> NOTE: All tests run in this JVM: [TestConfigSetImmutable, TestExtendedDismaxParser, TestPerFieldSimilarity, TestCharFilters, TestLeaderInitiatedRecoveryThread, TestRestoreCore, AsyncCallRequestStatusResponseTest, TestSolrQueryParser, StressHdfsTest, TestSolrIndexConfig, TestSearcherReuse, SolrTestCaseJ4Test, UnloadDistributedZkTest, PKIAuthenticationIntegrationTest, TestFieldSortValues, OverriddenZkACLAndCredentialsProvidersTest, RollingRestartTest, SpatialRPTFieldTypeTest, TestSuggestSpellingConverter, TestConfigReload, TestSolr4Spatial2, HLLSerializationTest, TestManagedSchemaFieldResource, TestSortingResponseWriter, AutoCommitTest, TestConfigSetsAPIZkFailure, TestRebalanceLeaders, TestMaxScoreQueryParser, TestSchemaVersionResource, TestMacros, QueryParsingTest, ClusterStateTest, AnalysisErrorHandlingTest, TestManagedSchema, TestGroupingSearch, RequestHandlersTest, TestSchemaNameResource, TestUseDocValuesAsStored2, CachingDirectoryFactoryTest, CoreAdminCreateDiscoverTest, DebugComponentTest, TestSolrJ, TestJmxIntegration, ShardSplitTest, TestShardHandlerFactory, DistanceUnitsTest, TestPostingsSolrHighlighter, StatelessScriptUpdateProcessorFactoryTest, LeaderElectionTest, TestReRankQParserPlugin, BinaryUpdateRequestHandlerTest, SortSpecParsingTest, CleanupOldIndexTest, SampleTest, DeleteReplicaTest, DistributedSuggestComponentTest, TestCollationField, TestCopyFieldCollectionResource, FieldMutatingUpdateProcessorTest, TestManagedSynonymFilterFactory, NoCacheHeaderTest, TestReversedWildcardFilterFactory, TestRuleBasedAuthorizationPlugin, SuggestComponentContextFilterQueryTest, TestSort, OverseerTest, CollectionStateFormat2Test, TestSolrXml, TestIndexSearcher, UpdateParamsTest, TestRecovery, TestSolrDeletionPolicy1, TestRequestStatusCollectionAPI, TestDefaultStatsCache, ScriptEngineTest, TestCollectionAPI, SuggesterWFSTTest, TestJmxMonitoredMap, TestReload, TestDownShardTolerantSearch, TestOverriddenPrefixQueryForCustomFieldType, SuggesterTSTTest, ZkStateWriterTest, TestFastWriter, TestXIncludeConfig, TestScoreJoinQPNoScore, TestSearchPerf, TestRestManager, TestFieldTypeCollectionResource, TestAuthenticationFramework, TriLevelCompositeIdRoutingTest, BasicDistributedZk2Test, HardAutoCommitTest, TestRangeQuery, SimpleFacetsTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, TestFiltering, BasicFunctionalityTest, ShowFileRequestHandlerTest, TestCoreDiscovery, CoreAdminHandlerTest, SpatialFilterTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, TestUpdate, QueryEqualityTest, SortByFunctionTest, SolrInfoMBeanTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, TestQueryTypes, TestOmitPositions, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, LoggingHandlerTest, IndexSchemaTest, TestCSVResponseWriter, TestAnalyzedSuggestions, JsonLoaderTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, SearchHandlerTest, TestLFUCache, PrimUtilsTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, TestUtils, ZkNodePropsTest, SliceStateTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, ActionThrottleTest, AliasIntegrationTest, AssignTest, ConcurrentDeleteAndCreateCollectionTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, OverseerTaskQueueTest, RemoteQueryErrorTest, SSLMigrationTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, TestDistribDocBasedVersion, TestExclusionRuleCollectionAccess, TestMiniSolrCloudCluster, TestSolrCloudWithKerberosAlt, HdfsBasicDistributedZk2Test, HdfsChaosMonkeyNothingIsSafeTest, HdfsCollectionsAPIDistributedZkTest, HdfsNNFailoverTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest, HdfsThreadLeakTest, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, DirectoryFactoryTest, HdfsDirectoryFactoryTest]
   [junit4] Completed [392/563 (1!)] on J2 in 12.24s, 3 tests, 1 error <<< FAILURES!

[...truncated 141 lines...]
   [junit4] Suite: org.apache.solr.index.hdfs.CheckHdfsIndexTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/init-core-data-001
   [junit4]   2> 4342768 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 4342768 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4342823 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4342833 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4342836 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4342851 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_46627_hdfs____igpckj/webapp
   [junit4]   2> 4342969 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4343225 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46627
   [junit4]   2> 4343287 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4343288 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4343301 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37565_datanode____.i40y15/webapp
   [junit4]   2> 4343420 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4343747 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37565
   [junit4]   2> 4343788 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4343790 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4343808 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_57628_datanode____.k7473/webapp
   [junit4]   2> 4343861 INFO  (IPC Server handler 3 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-5425b123-006c-4d62-b8b5-e8ad6be4168d node DatanodeRegistration(127.0.0.1, datanodeUuid=53147476-ab76-433d-b821-7ffed9dbe7d8, infoPort=37565, ipcPort=42432, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4343861 INFO  (IPC Server handler 3 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-4909e491-591a-42fa-b72c-1c8e79000a33 node DatanodeRegistration(127.0.0.1, datanodeUuid=53147476-ab76-433d-b821-7ffed9dbe7d8, infoPort=37565, ipcPort=42432, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4343953 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4344172 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:57628
   [junit4]   2> 4344254 INFO  (IPC Server handler 8 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-eac235cc-8b4b-4730-b5aa-ab6a40b2f47d node DatanodeRegistration(127.0.0.1, datanodeUuid=8985b884-e001-4a1e-8937-e60e78f5219f, infoPort=57628, ipcPort=55836, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4344254 INFO  (IPC Server handler 8 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-79cde9ca-ce66-420b-8081-f9c1d37b0741 node DatanodeRegistration(127.0.0.1, datanodeUuid=8985b884-e001-4a1e-8937-e60e78f5219f, infoPort=57628, ipcPort=55836, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4344386 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4344386 INFO  (Thread-237313) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4344386 INFO  (Thread-237313) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4344486 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkTestServer start zk server on port:40186
   [junit4]   2> 4344487 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344487 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344490 INFO  (zkCallback-2515-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@bfbb183 name:ZooKeeperConnection Watcher:127.0.0.1:40186 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344490 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344491 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344491 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4344494 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344494 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344496 INFO  (zkCallback-2516-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b315586 name:ZooKeeperConnection Watcher:127.0.0.1:40186/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344496 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344496 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344496 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 4344498 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 4344500 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 4344501 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 4344503 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 4344503 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 4344506 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 4344506 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 4344508 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4344508 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4344509 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 4344510 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 4344511 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 4344511 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 4344513 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 4344513 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 4344515 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4344515 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 4344516 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4344517 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4344518 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4344518 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4344520 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4344520 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 4344522 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 4344522 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4344819 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1
   [junit4]   2> 4344821 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4603914c{/,null,AVAILABLE}
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.ServerConnector Started ServerConnector@7704a0e9{HTTP/1.1}{127.0.0.1:54596}
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.Server Started @4347668ms
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=54596, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores, solr.data.dir=hdfs://localhost:45277/hdfs__localhost_45277__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.x_solr_build_solr-core_test_J0_temp_solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001_tempDir-002_control_data}
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001'
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344825 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344826 INFO  (zkCallback-2517-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1226be15 name:ZooKeeperConnection Watcher:127.0.0.1:40186/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344826 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344827 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344828 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 4344828 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/solr.xml
   [junit4]   2> 4344842 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores
   [junit4]   2> 4344843 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 553885970
   [junit4]   2> 4344843 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001]
   [junit4]   2> 4344843 WARN  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/lib
   [junit4]   2> 4344843 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4344844 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40186/solr
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344846 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344847 INFO  (zkCallback-2519-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32835e5f name:ZooKeeperConnection Watcher:127.0.0.1:40186 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344847 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344847 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344849 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344850 INFO  (zkCallback-2520-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@24f6cedf name:ZooKeeperConnection Watcher:127.0.0.1:40186/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344850 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344851 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 4344853 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 4344855 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 4344857 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 4344858 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 4344860 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4344861 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4344863 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4344864 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4344864 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54596_
   [junit4]   2> 4344865 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54596_
   [junit4]   2> 4344866 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 4344867 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 4344868 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4344869 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95192221676732420-127.0.0.1:54596_-n_0000000000
   [junit4]   2> 4344869 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54596_
   [junit4]   2> 4344869 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 4344871 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer Overseer (id=95192221676732420-127.0.0.1:54596_-n_0000000000) starting
   [junit4]   2> 4344872 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 4344877 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 4344878 INFO  (OverseerCollectionConfigSetProcessor-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 4344878 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4344878 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 4344896 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 4344896 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 4344897 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores
   [junit4]   2> 4344898 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {collection=control_collection, coreNodeName=, loadOnStartup=true, config=solrconfig.xml, shard=, schema=schema.xml, configSetProperties=configsetprops.json, dataDir=data/, name=collection1, transient=false}
   [junit4]   2> 4344898 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1
   [junit4]   2> 4344898 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 4344899 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 4344900 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 4344900 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 4344900 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 4344902 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "node_name":"127.0.0.1:54596_",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:54596",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down"} current state version: 0
   [junit4]   2> 4344903 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 4344903 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "node_name":"127.0.0.1:54596_",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:54596",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down"}
   [junit4]   2> 4344903 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 4344904 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 4344905 INFO  (zkCallback-2520-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4345903 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4345903 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 4345904 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 4345904 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 4345905 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 4345905 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1'
   [junit4]   2> 4345906 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4345906 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 4345909 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 4345914 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4345928 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 4345956 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4345964 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 4346226 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4346234 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 4346236 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4346245 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4346248 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4346251 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4346252 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4346253 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 4346253 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:45277/solr_hdfs_home
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1], dataDir=[hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a872a2d
   [junit4]   2> 4346255 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4346271 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4346272 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 4346282 WARN  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 4346282 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4346291 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 4346291 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 4346295 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 4346295 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4346295 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=5, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 4346310 INFO  (IPC Server handler 4 on 45277) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55884 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4909e491-591a-42fa-b72c-1c8e79000a33:NORMAL:127.0.0.1:51362|RBW], ReplicaUnderConstruction[[DISK]DS-79cde9ca-ce66-420b-8081-f9c1d37b0741:NORMAL:127.0.0.1:55884|FINALIZED]]} size 0
   [junit4]   2> 4346311 INFO  (IPC Server handler 5 on 45277) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51362 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-79cde9ca-ce66-420b-8081-f9c1d37b0741:NORMAL:127.0.0.1:55884|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5425b123-006c-4d62-b8b5-e8ad6be4168d:NORMAL:127.0.0.1:51362|FINALIZED]]} size 0
   [junit4]   2> 4346314 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@672f5e74); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4346314 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4346325 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 4346328 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4346328 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 4346328 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4346329 WARN  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 4346332 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xs

[...truncated too long message...]

/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/analysis/icu/lucene-analyzers-icu-5.5.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.7/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.2.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.suites -stdin
   [junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4] 	at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:801: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1000: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.

Total time: 230 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message