lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-5.x-Windows (32bit/jdk1.8.0_40-ea-b09) - Build # 4307 - Still Failing!
Date Mon, 03 Nov 2014 08:13:13 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4307/
Java: 32bit/jdk1.8.0_40-ea-b09 -server -XX:+UseSerialGC (asserts: true)

4 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([EBA28C3A09DF34FA:6A4402227E8054C6]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.client.solrj.impl.CloudSolrServerTest.allTests(CloudSolrServerTest.java:182)
	at org.apache.solr.client.solrj.impl.CloudSolrServerTest.doTest(CloudSolrServerTest.java:124)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest

Error Message:
ERROR: SolrZkClient opens=18 closes=17

Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=18 closes=17
	at __randomizedtesting.SeedInfo.seed([EBA28C3A09DF34FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:455)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:188)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest

Error Message:
6 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest:     1) Thread[id=475, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[EBA28C3A09DF34FA]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)    2) Thread[id=474, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[EBA28C3A09DF34FA]-SendThread(127.0.0.1:62870), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    3) Thread[id=485, name=zkCallback-59-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=482, name=CloudSolrServer ThreadPool-58-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=481, name=CloudSolrServer ThreadPool-58-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    6) Thread[id=501, name=zkCallback-59-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 6 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest: 
   1) Thread[id=475, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[EBA28C3A09DF34FA]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   2) Thread[id=474, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[EBA28C3A09DF34FA]-SendThread(127.0.0.1:62870), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   3) Thread[id=485, name=zkCallback-59-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=482, name=CloudSolrServer ThreadPool-58-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=481, name=CloudSolrServer ThreadPool-58-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   6) Thread[id=501, name=zkCallback-59-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([EBA28C3A09DF34FA]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=474, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[EBA28C3A09DF34FA]-SendThread(127.0.0.1:62870), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    2) Thread[id=485, name=zkCallback-59-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=482, name=CloudSolrServer ThreadPool-58-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=481, name=CloudSolrServer ThreadPool-58-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=501, name=zkCallback-59-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=474, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[EBA28C3A09DF34FA]-SendThread(127.0.0.1:62870), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   2) Thread[id=485, name=zkCallback-59-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=482, name=CloudSolrServer ThreadPool-58-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=481, name=CloudSolrServer ThreadPool-58-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=501, name=zkCallback-59-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([EBA28C3A09DF34FA]:0)




Build Log:
[...truncated 12637 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\init-core-data-001
   [junit4]   2> 185427 T329 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 185428 T329 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 185435 T329 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
   [junit4]   2> 185437 T329 oas.SolrTestCaseJ4.setUp ###Starting testWrongZkChrootTest
   [junit4]   2> 185446 T329 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 185452 T330 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 185760 T329 oasc.ZkTestServer.run start zk server on port:62844
   [junit4]   2> 185765 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 185914 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 185975 T331 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
   [junit4]   2> 188064 T336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cab240 name:ZooKeeperConnection Watcher:127.0.0.1:62844 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 188065 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 188066 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 188076 T329 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 188169 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 188176 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 188182 T338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@40ed9d name:ZooKeeperConnection Watcher:127.0.0.1:62844/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 188182 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 188182 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 188191 T329 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 188202 T329 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 188207 T329 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 188225 T329 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 188233 T329 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 188234 T329 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 188243 T329 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 188243 T329 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 188252 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml because it doesn't exist
   [junit4]   2> 188252 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\stopwords.txt because it doesn't exist
   [junit4]   2> 188252 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\protwords.txt because it doesn't exist
   [junit4]   2> 188254 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\currency.xml because it doesn't exist
   [junit4]   2> 188254 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\enumsConfig.xml because it doesn't exist
   [junit4]   2> 188254 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\open-exchange-rates.json because it doesn't exist
   [junit4]   2> 188254 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\mapping-ISOLatin1Accent.txt because it doesn't exist
   [junit4]   2> 188256 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\old_synonyms.txt because it doesn't exist
   [junit4]   2> 188257 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\synonyms.txt because it doesn't exist
   [junit4]   2> 188277 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 188279 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 188289 T340 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@747d79 name:ZooKeeperConnection Watcher:127.0.0.1:62844/solr/xyz/foo got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 188290 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 188290 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 188293 T329 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 188308 T329 oas.SolrTestCaseJ4.tearDown ###Ending testWrongZkChrootTest
   [junit4]   2> 188316 T329 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62844 62844
   [junit4]   2> 188316 T331 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14974b569970002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 190525 T330 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62844 62844
   [junit4]   2> 190533 T329 oas.SolrTestCaseJ4.setUp ###Starting testShutdown
   [junit4]   2> 190536 T329 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 190537 T341 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 190636 T329 oasc.ZkTestServer.run start zk server on port:62857
   [junit4]   2> 190636 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 190638 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 190648 T347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cd199a name:ZooKeeperConnection Watcher:127.0.0.1:62857 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 190648 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 190648 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 190648 T329 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 190661 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 190665 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 190666 T342 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14974b57c940000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 190672 T349 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d421d1 name:ZooKeeperConnection Watcher:127.0.0.1:62857/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 190673 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 190673 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 190673 T329 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 190685 T329 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 190690 T329 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 190697 T329 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 190706 T329 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 190706 T329 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 190712 T329 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 190712 T329 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\stopwords.txt because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\protwords.txt because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\currency.xml because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\enumsConfig.xml because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\open-exchange-rates.json because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\mapping-ISOLatin1Accent.txt because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\old_synonyms.txt because it doesn't exist
   [junit4]   2> 190719 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\synonyms.txt because it doesn't exist
   [junit4]   2> 190727 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 190730 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 190734 T350 oaz.ClientCnxn$SendThread.run WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.BindException: Cannot assign requested address: no further information
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2> 
   [junit4]   2> 191978 T329 oas.SolrTestCaseJ4.tearDown ###Ending testShutdown
   [junit4]   2> 191980 T329 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62857 62857
   [junit4]   2> 194410 T341 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62857 62857
   [junit4]   2> 194422 T329 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 194425 T329 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 194426 T352 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 194535 T329 oasc.ZkTestServer.run start zk server on port:62870
   [junit4]   2> 194535 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 194538 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 194544 T358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b32aa8 name:ZooKeeperConnection Watcher:127.0.0.1:62870 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 194550 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 194550 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 194550 T329 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 194560 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 194563 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 194566 T360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18ef6d name:ZooKeeperConnection Watcher:127.0.0.1:62870/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 194566 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 194566 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 194566 T329 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 194571 T329 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 194582 T329 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 194586 T329 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 194591 T329 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 194591 T329 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 194599 T329 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 194599 T329 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 194604 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml because it doesn't exist
   [junit4]   2> 194605 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\stopwords.txt because it doesn't exist
   [junit4]   2> 194605 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\protwords.txt because it doesn't exist
   [junit4]   2> 194605 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\currency.xml because it doesn't exist
   [junit4]   2> 194606 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\enumsConfig.xml because it doesn't exist
   [junit4]   2> 194606 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\open-exchange-rates.json because it doesn't exist
   [junit4]   2> 194606 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\mapping-ISOLatin1Accent.txt because it doesn't exist
   [junit4]   2> 194606 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\old_synonyms.txt because it doesn't exist
   [junit4]   2> 194606 T329 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\synonyms.txt because it doesn't exist
   [junit4]   2> 194896 T329 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 194910 T329 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62877
   [junit4]   2> 194910 T329 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 194910 T329 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 194910 T329 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-004
   [junit4]   2> 194910 T329 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-004\'
   [junit4]   2> 194942 T329 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-004\solr.xml
   [junit4]   2> 194964 T329 oasc.CoreContainer.<init> New CoreContainer 17807539
   [junit4]   2> 194964 T329 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-004\]
   [junit4]   2> 194966 T329 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 194966 T329 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 194966 T329 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 194967 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 194967 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 194967 T329 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 194967 T329 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 194967 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 194967 T329 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 194967 T329 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 194967 T329 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 194967 T329 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 194967 T329 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 194967 T329 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 194972 T329 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62870/solr
   [junit4]   2> 195015 T329 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 195016 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 195019 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 195028 T371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@59444d name:ZooKeeperConnection Watcher:127.0.0.1:62870 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 195028 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 195028 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 195044 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 195048 T373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15fa12a name:ZooKeeperConnection Watcher:127.0.0.1:62870/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 195048 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 195068 T329 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 195074 T329 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 195092 T329 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 195096 T329 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 195100 T329 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 195113 T329 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 195115 T329 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62877_
   [junit4]   2> 195121 T329 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62877_
   [junit4]   2> 195125 T329 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 195134 T329 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 195137 T329 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 195153 T329 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:62877_
   [junit4]   2> 195154 T329 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 195156 T329 oasc.Overseer.start Overseer (id=92733590420783107-127.0.0.1:62877_-n_0000000000) starting
   [junit4]   2> 195181 T329 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 195224 T329 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 195253 T329 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 195255 T375 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 195261 T329 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 195275 T329 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 195300 T374 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 195318 T377 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 195319 T377 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 195336 T377 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 195337 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 195377 T374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62877",
   [junit4]   2> 	  "node_name":"127.0.0.1:62877_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 195378 T374 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 195399 T374 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
   [junit4]   2> 195418 T374 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 195444 T378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 196414 T377 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 196414 T377 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 196416 T377 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 196416 T377 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 196422 T377 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 196423 T377 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-004\collection1\'
   [junit4]   2> 196469 T377 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 196483 T377 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 196488 T377 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 196521 T377 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 196659 T377 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 196661 T377 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 196662 T377 oass.IndexSchema.loadCopyFields WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 196662 T377 oass.IndexSchema.loadCopyFields WARN Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 196663 T377 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 196663 T377 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 196663 T377 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/control/data\
   [junit4]   2> 196663 T377 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 196664 T377 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/control/data\
   [junit4]   2> 196664 T377 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/control/data\index/
   [junit4]   2> 196664 T377 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 196665 T377 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/control/data\index
   [junit4]   2> 196667 T377 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-fbc88b)),segFN=segments_1,generation=1}
   [junit4]   2> 196667 T377 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 196669 T377 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 196670 T377 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 196671 T377 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 196671 T377 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 196671 T377 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 196671 T377 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 196671 T377 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 196672 T377 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 196672 T377 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 196672 T377 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 196672 T377 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 196675 T377 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 196679 T377 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 196680 T377 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 196681 T377 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 196687 T377 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 196687 T377 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 196688 T377 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-fbc88b)),segFN=segments_1,generation=1}
   [junit4]   2> 196688 T377 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 196689 T377 oass.SolrIndexSearcher.<init> Opening Searcher@13f699c[collection1] main
   [junit4]   2> 196689 T377 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 196691 T377 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 196691 T377 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 196702 T377 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 196703 T377 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 196703 T377 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 196704 T377 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 196704 T377 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 196707 T377 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 196714 T377 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 196714 T377 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 196714 T377 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 196716 T377 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 196716 T379 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13f699c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 196717 T382 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62877 collection:control_collection shard:shard1
   [junit4]   2> 196718 T329 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 196718 T329 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 196719 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 196721 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 196728 T384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1094045 name:ZooKeeperConnection Watcher:127.0.0.1:62870/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 196728 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 196728 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 196733 T329 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 196743 T329 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 196743 T382 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 196757 T382 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 196762 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 196764 T382 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 196764 T382 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C199 name=collection1 org.apache.solr.core.SolrCore@df42b9 url=http://127.0.0.1:62877/collection1 node=127.0.0.1:62877_ C199_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:62877, node_name=127.0.0.1:62877_, state=down}
   [junit4]   2> 196770 T382 C199 P62877 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62877/collection1/
   [junit4]   2> 196771 T382 C199 P62877 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 196771 T382 C199 P62877 oasc.SyncStrategy.syncToMe http://127.0.0.1:62877/collection1/ has no replicas
   [junit4]   2> 196771 T382 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62877/collection1/ shard1
   [junit4]   2> 196778 T382 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 196839 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 196963 T378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 196968 T385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 197006 T382 oasc.ZkController.register We are http://127.0.0.1:62877/collection1/ and leader is http://127.0.0.1:62877/collection1/
   [junit4]   2> 197006 T382 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62877
   [junit4]   2> 197006 T382 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 197006 T382 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 197006 T382 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 197022 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 197038 T374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62877",
   [junit4]   2> 	  "node_name":"127.0.0.1:62877_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 197042 T329 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 197044 T329 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 197050 T329 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62889
   [junit4]   2> 197051 T329 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 197051 T329 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 197051 T329 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-005
   [junit4]   2> 197052 T329 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-005\'
   [junit4]   2> 197093 T329 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-005\solr.xml
   [junit4]   2> 197117 T329 oasc.CoreContainer.<init> New CoreContainer 6060430
   [junit4]   2> 197119 T329 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-005\]
   [junit4]   2> 197120 T329 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 197121 T329 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 197121 T329 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 197122 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 197123 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 197123 T329 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 197123 T329 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 197123 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 197123 T329 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 197128 T329 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 197128 T329 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 197128 T329 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 197128 T329 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 197128 T329 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 197130 T329 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62870/solr
   [junit4]   2> 197130 T329 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 197130 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 197138 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 197149 T396 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1415270 name:ZooKeeperConnection Watcher:127.0.0.1:62870 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 197151 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 197151 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 197158 T378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 197158 T385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 197159 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 197164 T398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10d97fb name:ZooKeeperConnection Watcher:127.0.0.1:62870/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 197166 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 197180 T329 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 198267 T329 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62889_
   [junit4]   2> 198269 T329 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62889_
   [junit4]   2> 198282 T329 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 198311 T400 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 198311 T400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 198313 T400 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 198313 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 198320 T374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62889",
   [junit4]   2> 	  "node_name":"127.0.0.1:62889_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 198320 T374 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 198320 T374 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 1
   [junit4]   2> 198320 T374 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 198438 T399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 198439 T385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 198439 T378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 199391 T400 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 199391 T400 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 199392 T400 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 199393 T400 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 199396 T400 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 199396 T400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-005\collection1\'
   [junit4]   2> 199450 T400 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 199467 T400 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 199481 T400 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 199491 T400 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 199670 T400 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 199670 T400 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 199672 T400 oass.IndexSchema.loadCopyFields WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 199675 T400 oass.IndexSchema.loadCopyFields WARN Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 199675 T400 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 199675 T400 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 199678 T400 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-005\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/jetty1\
   [junit4]   2> 199678 T400 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 199679 T400 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/jetty1\
   [junit4]   2> 199679 T400 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/jetty1\index/
   [junit4]   2> 199679 T400 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 199681 T400 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-003/jetty1\index
   [junit4]   2> 199682 T400 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-16b425)),segFN=segments_1,generation=1}
   [junit4]   2> 199682 T400 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 199684 T400 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 199685 T400 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 199685 T400 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 199685 T400 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 199686 T400 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 199687 T400 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 199687 T400 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 199687 T400 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 199687 T400 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 199687 T400 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 199688 T400 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 199695 T400 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 199696 T400 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 199698 T400 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 199700 T400 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 199704 T400 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 199704 T400 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 199706 T400 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-16b425)),segFN=segments_1,generation=1}
   [junit4]   2> 199706 T400 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 199706 T400 oass.SolrIndexSearcher.<init> Opening Searcher@8e7f1f[collection1] main
   [junit4]   2> 199706 T400 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 199710 T400 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 199710 T400 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 199712 T400 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 199712 T400 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 199712 T400 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 199715 T400 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 199716 T400 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 199716 T400 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 199716 T400 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 199719 T400 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 199719 T401 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8e7f1f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 199722 T404 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62889 collection:collection1 shard:shard2
   [junit4]   2> 199723 T329 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 199724 T329 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 199724 T404 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 199740 T404 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 199746 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 199748 T404 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 199748 T404 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C200 name=collection1 org.apache.solr.core.SolrCore@2f847f url=http://127.0.0.1:62889/collection1 node=127.0.0.1:62889_ C200_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:62889, node_name=127.0.0.1:62889_, state=down}
   [junit4]   2> 199748 T404 C200 P62889 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62889/collection1/
   [junit4]   2> 199751 T404 C200 P62889 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 199751 T404 C200 P62889 oasc.SyncStrategy.syncToMe http://127.0.0.1:62889/collection1/ has no replicas
   [junit4]   2> 199752 T404 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62889/collection1/ shard2
   [junit4]   2> 199752 T404 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 199900 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 199906 T399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 199908 T385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 199909 T378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 199942 T404 oasc.ZkController.register We are http://127.0.0.1:62889/collection1/ and leader is http://127.0.0.1:62889/collection1/
   [junit4]   2> 199943 T404 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62889
   [junit4]   2> 199943 T404 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 199943 T404 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 199943 T404 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 199948 T378 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 199978 T374 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62889",
   [junit4]   2> 	  "node_name":"127.0.0.1:62889_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 200095 T399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 200097 T385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 200098 T378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 200125 T329 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 200127 T329 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 200133 T329 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:62898
   [junit4]   2> 200135 T329 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 200135 T329 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 200137 T329 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-006
   [junit4]   2> 200137 T329 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-006\'
   [junit4]   2> 200175 T329 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-006\solr.xml
   [junit4]   2> 200202 T329 oasc.CoreContainer.<init> New CoreContainer 23246489
   [junit4]   2> 200203 T329 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrServerTest-EBA28C3A09DF34FA-001\tempDir-006\]
   [junit4]   2> 200204 T329 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 200204 T329 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 200204 T329 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 200204 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 200204 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 200206 T329 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 200207 T329 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 200207 T329 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 200207 T329 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 200207 T329 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 200209 T329 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 200209 T329 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 200209 T329 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 200209 T329 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 200209 T329 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62870/solr
   [junit4]   2> 200212 T329 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 200212 T329 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 200215 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 200223 T415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@797105 name:ZooKeeperConnection Watcher:127.0.0.1:62870 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 200225 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 200225 T329 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 200233 T329 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 200242 T417 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21a330 name:ZooKeeperConnection Watcher:127.0.0.1:62870/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 200243 T329 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 200262 T329 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 201349 T329 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62898_
   [junit4]   2> 201350 T329 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62898_
   [junit4]   2> 201361 T329 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 201374 T419 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 201374 T419 oasc.ZkController.publish numShards not found on descriptor - re

[...truncated too long message...]

oll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=482, name=CloudSolrServer ThreadPool-58-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=481, name=CloudSolrServer ThreadPool-58-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    6) Thread[id=501, name=zkCallback-59-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EBA28C3A09DF34FA]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=474, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[EBA28C3A09DF34FA]-SendThread(127.0.0.1:62870), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   [junit4]    >    2) Thread[id=485, name=zkCallback-59-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=482, name=CloudSolrServer ThreadPool-58-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=481, name=CloudSolrServer ThreadPool-58-thread-1, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=501, name=zkCallback-59-thread-2, state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EBA28C3A09DF34FA]:0)
   [junit4] Completed in 80.63s, 3 tests, 2 failures, 2 errors <<< FAILURES!

[...truncated 94 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:525: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:473: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build.xml:202: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\common-build.xml:502: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:1359: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:966: There were test failures: 54 suites, 317 tests, 3 suite-level errors, 1 failure, 226 ignored

Total time: 171 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b09 -server -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message