lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-Tests-trunk-Java7 - Build # 4712 - Still Failing
Date Tue, 27 May 2014 01:00:33 GMT
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java7/4712/

4 tests failed.
REGRESSION:  org.apache.solr.cloud.HttpPartitionTest.testDistribSearch

Error Message:
No registered leader was found after waiting for 60000ms , collection: c8n_1x3_lf slice: shard1

Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 60000ms , collection: c8n_1x3_lf slice: shard1
	at __randomizedtesting.SeedInfo.seed([FD9F9A7B0527741B:7C79146372781427]:0)
	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:567)
	at org.apache.solr.cloud.HttpPartitionTest.testRf3WithLeaderFailover(HttpPartitionTest.java:349)
	at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:148)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:724)


FAILED:  junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
SolrCore.getOpenCount()==2

Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
	at __randomizedtesting.SeedInfo.seed([FD9F9A7B0527741B]:0)
	at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
	at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:182)
	at sun.reflect.GeneratedMethodAccessor57.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:724)


FAILED:  junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage:     1) Thread[id=17041, name=coreZkRegister-3177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)    2) Thread[id=17039, name=Thread-3969, state=WAITING, group=TGRP-TestManagedResourceStorage]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:503)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)    3) Thread[id=17038, name=searcherExecutor-3182-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)    4) Thread[id=17035, name=Thread-3968, state=TIMED_WAITING, group=Overseer state updater.]         at java.lang.Object.wait(Native Method)         at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:240)         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:563)         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:527)         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)         at java.lang.Thread.run(Thread.java:724)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage: 
   1) Thread[id=17041, name=coreZkRegister-3177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
   2) Thread[id=17039, name=Thread-3969, state=WAITING, group=TGRP-TestManagedResourceStorage]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:503)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
   3) Thread[id=17038, name=searcherExecutor-3182-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
   4) Thread[id=17035, name=Thread-3968, state=TIMED_WAITING, group=Overseer state updater.]
        at java.lang.Object.wait(Native Method)
        at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:240)
        at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:563)
        at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:527)
        at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
        at java.lang.Thread.run(Thread.java:724)
	at __randomizedtesting.SeedInfo.seed([FD9F9A7B0527741B]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=17041, name=coreZkRegister-3177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)    2) Thread[id=17039, name=Thread-3969, state=WAITING, group=TGRP-TestManagedResourceStorage]         at java.lang.Object.wait(Native Method)         at java.lang.Object.wait(Object.java:503)         at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)    3) Thread[id=17038, name=searcherExecutor-3182-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:724)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=17041, name=coreZkRegister-3177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
   2) Thread[id=17039, name=Thread-3969, state=WAITING, group=TGRP-TestManagedResourceStorage]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:503)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
   3) Thread[id=17038, name=searcherExecutor-3182-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:724)
	at __randomizedtesting.SeedInfo.seed([FD9F9A7B0527741B]:0)




Build Log:
[...truncated 10999 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/init-core-data-001
   [junit4]   2> 1884600 T5696 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1884607 T5696 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1884608 T5696 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1884608 T5697 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1884709 T5696 oasc.ZkTestServer.run start zk server on port:11389
   [junit4]   2> 1884710 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1884713 T5703 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79967682 name:ZooKeeperConnection Watcher:127.0.0.1:11389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1884714 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1884714 T5696 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1884727 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1884728 T5705 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3806973a name:ZooKeeperConnection Watcher:127.0.0.1:11389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1884729 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1884729 T5696 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1884739 T5696 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1884741 T5696 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1884743 T5696 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1884745 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1884746 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1884750 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1884751 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1884754 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1884755 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1884768 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1884769 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1884772 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1884773 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1884775 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1884776 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1884779 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1884779 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1884787 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1884788 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1884790 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1884791 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1884794 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1884794 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1884801 T5696 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1884802 T5696 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1885813 T5696 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1885818 T5696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:42600
   [junit4]   2> 1885819 T5696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1885819 T5696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1885819 T5696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002
   [junit4]   2> 1885820 T5696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/'
   [junit4]   2> 1885850 T5696 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/solr.xml
   [junit4]   2> 1885925 T5696 oasc.CoreContainer.<init> New CoreContainer 1310157797
   [junit4]   2> 1885925 T5696 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/]
   [junit4]   2> 1885927 T5696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1885927 T5696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1885928 T5696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1885928 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1885928 T5696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1885928 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1885929 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1885929 T5696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1885929 T5696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1885930 T5696 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1885930 T5696 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1885931 T5696 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1885931 T5696 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11389/solr
   [junit4]   2> 1885932 T5696 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1885932 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1885934 T5716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63acaf70 name:ZooKeeperConnection Watcher:127.0.0.1:11389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1885935 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1885938 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1885939 T5718 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@608c5e2a name:ZooKeeperConnection Watcher:127.0.0.1:11389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1885939 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1885941 T5696 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1885944 T5696 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1885948 T5696 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1885961 T5696 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1885964 T5696 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1885973 T5696 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1885975 T5696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61923_
   [junit4]   2> 1885976 T5696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:61923_
   [junit4]   2> 1885986 T5696 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1885987 T5696 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1885999 T5696 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:61923_
   [junit4]   2> 1885999 T5696 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1886001 T5696 oasc.Overseer.start Overseer (id=91825762978824195-127.0.0.1:61923_-n_0000000000) starting
   [junit4]   2> 1886003 T5696 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1886011 T5720 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1886011 T5696 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1886013 T5696 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1886014 T5696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1886016 T5719 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1886021 T5721 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1886021 T5721 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1886022 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1886022 T5721 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1886023 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1886023 T5719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:61923",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:61923_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1886024 T5719 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1886024 T5719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1886025 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1886026 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1887023 T5721 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1887023 T5721 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1887024 T5721 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1887024 T5721 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1887025 T5721 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1887025 T5721 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/collection1/'
   [junit4]   2> 1887027 T5721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1887028 T5721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1887028 T5721 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1887112 T5721 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1887195 T5721 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1887196 T5721 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1887210 T5721 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1887862 T5721 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1887878 T5721 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1887882 T5721 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1887894 T5721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1887899 T5721 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1887904 T5721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1887905 T5721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1887906 T5721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1887906 T5721 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1887907 T5721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1887907 T5721 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1887908 T5721 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1887908 T5721 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1887908 T5721 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-002/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/control/data/
   [junit4]   2> 1887909 T5721 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d1c1393
   [junit4]   2> 1887910 T5721 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/control/data
   [junit4]   2> 1887910 T5721 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/control/data/index/
   [junit4]   2> 1887910 T5721 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1887911 T5721 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/control/data/index
   [junit4]   2> 1887912 T5721 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=54.822265625, floorSegmentMB=0.2646484375, forceMergeDeletesPctAllowed=17.86287376035696, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.862463096105087
   [junit4]   2> 1887913 T5721 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@439a67b7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@276adf3),segFN=segments_1,generation=1}
   [junit4]   2> 1887913 T5721 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1887919 T5721 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1887920 T5721 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1887920 T5721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1887920 T5721 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1887921 T5721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1887921 T5721 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1887922 T5721 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1887923 T5721 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1887923 T5721 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1887924 T5721 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1887924 T5721 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1887925 T5721 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1887925 T5721 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1887926 T5721 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1887926 T5721 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1887927 T5721 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1887928 T5721 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1887946 T5721 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1887953 T5721 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1887953 T5721 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1887954 T5721 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=68.7294921875, floorSegmentMB=0.625, forceMergeDeletesPctAllowed=12.692664827202885, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1887955 T5721 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@439a67b7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@276adf3),segFN=segments_1,generation=1}
   [junit4]   2> 1887955 T5721 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1887956 T5721 oass.SolrIndexSearcher.<init> Opening Searcher@49f23140[collection1] main
   [junit4]   2> 1887956 T5721 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1887957 T5721 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1887957 T5721 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1887958 T5721 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1887958 T5721 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1887958 T5721 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1887959 T5721 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1887959 T5721 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1887960 T5721 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1887960 T5721 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1887964 T5722 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49f23140[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1887968 T5721 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1887969 T5725 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:61923 collection:control_collection shard:shard1
   [junit4]   2> 1887969 T5696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1887970 T5725 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1887970 T5696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1887975 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1887985 T5728 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@676b1fcc name:ZooKeeperConnection Watcher:127.0.0.1:11389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1887985 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1887987 T5725 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1887987 T5696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1887989 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1887989 T5725 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1887989 T5725 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 1887989 T5696 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1887990 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> ASYNC  NEW_CORE C694 name=collection1 org.apache.solr.core.SolrCore@798248e1 url=http://127.0.0.1:61923/collection1 node=127.0.0.1:61923_ C694_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:61923, core=collection1, node_name=127.0.0.1:61923_}
   [junit4]   2> 1887990 T5725 C694 P61923 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:61923/collection1/
   [junit4]   2> 1887991 T5725 C694 P61923 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1887991 T5725 C694 P61923 oasc.SyncStrategy.syncToMe http://127.0.0.1:61923/collection1/ has no replicas
   [junit4]   2> 1887991 T5725 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:61923/collection1/ shard1
   [junit4]   2> 1887992 T5725 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1887992 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1887993 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1887993 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1887997 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1887998 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1888000 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1888102 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1888102 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1888150 T5725 oasc.ZkController.register We are http://127.0.0.1:61923/collection1/ and leader is http://127.0.0.1:61923/collection1/
   [junit4]   2> 1888150 T5725 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:61923
   [junit4]   2> 1888150 T5725 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1888150 T5725 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1888151 T5725 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1888152 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1888152 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1888152 T5725 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1888152 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1888154 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1888154 T5719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:61923",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:61923_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1888164 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1888266 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1888266 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1889111 T5696 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1889112 T5696 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1889115 T5696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49617
   [junit4]   2> 1889115 T5696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1889116 T5696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1889116 T5696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003
   [junit4]   2> 1889116 T5696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/'
   [junit4]   2> 1889147 T5696 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/solr.xml
   [junit4]   2> 1889221 T5696 oasc.CoreContainer.<init> New CoreContainer 614273042
   [junit4]   2> 1889222 T5696 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/]
   [junit4]   2> 1889224 T5696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1889224 T5696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1889224 T5696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1889225 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1889225 T5696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1889225 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1889226 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1889226 T5696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1889226 T5696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1889227 T5696 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1889227 T5696 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1889228 T5696 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1889228 T5696 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11389/solr
   [junit4]   2> 1889228 T5696 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1889229 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1889233 T5739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@438a2085 name:ZooKeeperConnection Watcher:127.0.0.1:11389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1889234 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1889249 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1889251 T5741 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6062d17b name:ZooKeeperConnection Watcher:127.0.0.1:11389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1889252 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1889264 T5696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1890267 T5696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:13151_
   [junit4]   2> 1890271 T5696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:13151_
   [junit4]   2> 1890292 T5742 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1890293 T5742 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1890294 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1890294 T5742 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1890294 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1890295 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1890296 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1890296 T5719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:13151",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:13151_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1890297 T5719 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1890297 T5719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1890300 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1890301 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1890301 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1890301 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1891296 T5742 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1891296 T5742 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1891297 T5742 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1891297 T5742 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1891298 T5742 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1891298 T5742 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/collection1/'
   [junit4]   2> 1891300 T5742 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1891301 T5742 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1891301 T5742 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1891384 T5742 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1891466 T5742 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1891467 T5742 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1891480 T5742 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1892029 T5742 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1892040 T5742 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1892043 T5742 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1892052 T5742 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1892056 T5742 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1892060 T5742 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1892060 T5742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1892061 T5742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1892061 T5742 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1892062 T5742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1892062 T5742 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1892062 T5742 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1892062 T5742 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1892063 T5742 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-003/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty1/
   [junit4]   2> 1892063 T5742 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d1c1393
   [junit4]   2> 1892064 T5742 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty1
   [junit4]   2> 1892064 T5742 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty1/index/
   [junit4]   2> 1892064 T5742 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 1892065 T5742 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty1/index
   [junit4]   2> 1892065 T5742 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=54.822265625, floorSegmentMB=0.2646484375, forceMergeDeletesPctAllowed=17.86287376035696, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.862463096105087
   [junit4]   2> 1892066 T5742 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@502dc227 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb2265d),segFN=segments_1,generation=1}
   [junit4]   2> 1892066 T5742 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1892071 T5742 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1892072 T5742 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1892072 T5742 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1892072 T5742 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1892073 T5742 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1892073 T5742 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1892073 T5742 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1892074 T5742 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1892074 T5742 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1892075 T5742 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1892075 T5742 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1892075 T5742 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1892076 T5742 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1892076 T5742 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1892077 T5742 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1892077 T5742 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1892078 T5742 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1892090 T5742 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1892094 T5742 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1892095 T5742 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1892095 T5742 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=68.7294921875, floorSegmentMB=0.625, forceMergeDeletesPctAllowed=12.692664827202885, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1892096 T5742 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@502dc227 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb2265d),segFN=segments_1,generation=1}
   [junit4]   2> 1892096 T5742 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1892097 T5742 oass.SolrIndexSearcher.<init> Opening Searcher@6e0ef977[collection1] main
   [junit4]   2> 1892097 T5742 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1892098 T5742 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1892098 T5742 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1892098 T5742 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1892099 T5742 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1892099 T5742 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1892099 T5742 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1892100 T5742 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1892100 T5742 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 1892100 T5742 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1892104 T5743 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e0ef977[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 1892107 T5742 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1892108 T5746 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:13151 collection:collection1 shard:shard1
   [junit4]   2> 1892108 T5696 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1892108 T5696 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1892109 T5746 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1892126 T5746 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1892128 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1892128 T5746 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1892129 T5746 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C695 name=collection1 org.apache.solr.core.SolrCore@2d29c673 url=http://127.0.0.1:13151/collection1 node=127.0.0.1:13151_ C695_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:13151, core=collection1, node_name=127.0.0.1:13151_}
   [junit4]   2> 1892129 T5746 C695 P13151 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:13151/collection1/
   [junit4]   2> 1892129 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1892129 T5746 C695 P13151 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1892130 T5746 C695 P13151 oasc.SyncStrategy.syncToMe http://127.0.0.1:13151/collection1/ has no replicas
   [junit4]   2> 1892130 T5746 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:13151/collection1/ shard1
   [junit4]   2> 1892130 T5746 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1892132 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1892133 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892133 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892133 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892138 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1892151 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1892255 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892255 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892255 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892291 T5746 oasc.ZkController.register We are http://127.0.0.1:13151/collection1/ and leader is http://127.0.0.1:13151/collection1/
   [junit4]   2> 1892291 T5746 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:13151
   [junit4]   2> 1892291 T5746 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1892291 T5746 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1892291 T5746 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1892294 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1892294 T5746 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1892294 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1892295 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1892295 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1892296 T5719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:13151",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:13151_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1892298 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1892401 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892401 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892401 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1892948 T5696 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1892949 T5696 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1892952 T5696 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55169
   [junit4]   2> 1892952 T5696 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1892953 T5696 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1892953 T5696 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004
   [junit4]   2> 1892953 T5696 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/'
   [junit4]   2> 1892984 T5696 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/solr.xml
   [junit4]   2> 1893058 T5696 oasc.CoreContainer.<init> New CoreContainer 1180124718
   [junit4]   2> 1893059 T5696 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/]
   [junit4]   2> 1893060 T5696 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1893060 T5696 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1893061 T5696 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1893061 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1893061 T5696 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1893062 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1893062 T5696 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1893062 T5696 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1893063 T5696 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1893063 T5696 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1893064 T5696 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1893064 T5696 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1893064 T5696 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:11389/solr
   [junit4]   2> 1893065 T5696 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1893066 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1893069 T5758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bc09a16 name:ZooKeeperConnection Watcher:127.0.0.1:11389 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1893069 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1893086 T5696 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1893087 T5760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fd308e0 name:ZooKeeperConnection Watcher:127.0.0.1:11389/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1893088 T5696 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1893103 T5696 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1894106 T5696 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38919_
   [junit4]   2> 1894110 T5696 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38919_
   [junit4]   2> 1894123 T5761 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1894124 T5761 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1894131 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1894131 T5761 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1894131 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1894132 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1894133 T5719 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1894134 T5719 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:38919",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:38919_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1894134 T5719 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1894134 T5719 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1894137 T5718 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1894147 T5760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1894147 T5741 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1894147 T5718 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1894147 T5728 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1895133 T5761 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1895133 T5761 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1895134 T5761 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1895134 T5761 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1895135 T5761 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1895135 T5761 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/collection1/'
   [junit4]   2> 1895137 T5761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1895137 T5761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1895138 T5761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1895221 T5761 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 1895302 T5761 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1895304 T5761 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1895317 T5761 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1895948 T5761 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1895963 T5761 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1895967 T5761 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1895978 T5761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1895983 T5761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1895987 T5761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1895988 T5761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1895989 T5761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1895989 T5761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1895990 T5761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1895990 T5761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1895991 T5761 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1895991 T5761 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1895991 T5761 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-004/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty2/
   [junit4]   2> 1895992 T5761 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d1c1393
   [junit4]   2> 1895993 T5761 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty2
   [junit4]   2> 1895993 T5761 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty2/index/
   [junit4]   2> 1895993 T5761 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 1895994 T5761 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.HttpPartitionTest-FD9F9A7B0527741B-001/tempDir-001/jetty2/index
   [junit4]   2> 1895994 T5761 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=54.822265625, floorSegmentMB=0.2646484375, forceMergeDeletesPctAllowed=17.86287376035696, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.862463096105087
   [junit4]   2> 1895995 T5761 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@4d5d86d6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@484e3cb6),segFN=segments_1,generation=1}
   [junit4]   2> 1895996 T5761 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1896003 T5761 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1896003 T5761 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1896004 T5761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1896004 T5761 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1896005 T5761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1896005 T5761 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1896005 T5761 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1896006 T5761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1896006 T5761 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1896007 T5761 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1896008 T5761 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1896008 T5761 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1896008 T5761 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1896009 T5761 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1896010 T5761 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1896011 T5761 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1896011 T5761 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1896028 T5761 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1896034 T5761 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1896035 T5761 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1896035 T5761 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=68.7294921875, floorSegmentMB=0.625, forceMergeDeletesPctAllowed=12.692664827202885, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1896036 T5761 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@4d5d86d6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@484e3cb6),segFN=segments_1,generation=1}
   [junit4]   2> 1896036 T5761 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1896037 T5761 oass.SolrIndexSearcher.<init> Opening Searcher@31159d19[collection1] main
   [junit4]   2> 1896037 T5761 oascc.ZkStateReader.readConfigName Load collection config from:/col

[...truncated too long message...]

ryFactoryTest, SuggesterTest, TestFreeTextSuggestions, PrimitiveFieldTypeTest, TestSurroundQueryParser, DistributedQueryComponentOptimizationTest, SyncSliceTest, DistribCursorPagingTest, TestSolrQueryParserDefaultOperatorResource, SuggesterFSTTest, DistributedSpellCheckComponentTest, ResponseLogComponentTest, SliceStateUpdateTest, PreAnalyzedFieldTest, DistributedQueryComponentCustomSortTest, DocumentBuilderTest, MoreLikeThisHandlerTest, TestValueSourceCache, TestExceedMaxTermLength, TestPHPSerializedResponseWriter, TestSuggestSpellingConverter, TestCursorMarkWithoutUniqueKey, BasicDistributedZk2Test, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, ZkControllerTest, TestJoin, TestSolr4Spatial, StatsComponentTest, TestGroupingSearch, HighlighterTest, CurrencyFieldOpenExchangeTest, SolrIndexSplitterTest, AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, TestFoldingMultitermQuery, SuggesterTSTTest, TestTrie, PolyFieldTest, SchemaVersionSpecificBehaviorTest, TestUpdate, TestWordDelimiterFilterFactory, SortByFunctionTest, DistanceFunctionTest, XsltUpdateRequestHandlerTest, LukeRequestHandlerTest, TermsComponentTest, PathHierarchyTokenizerFactoryTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, IndexSchemaTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, QueryParsingTest, TestBinaryResponseWriter, UpdateParamsTest, TestQuerySenderNoQuery, SampleTest, TestDocSet, TestSearchPerf, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, TestLuceneMatchVersion, SpellPossibilityIteratorTest, SynonymTokenizerTest, EchoParamsTest, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, LegacyHTMLStripCharFilterTest, TimeZoneUtilsTest, ResourceLoaderTest, ChaosMonkeyNothingIsSafeTest, MigrateRouteKeyTest, OverseerStatusTest, SolrXmlInZkTest, TestDistribDocBasedVersion, HdfsBasicDistributedZkTest, HdfsChaosMonkeySafeLeaderTest, HdfsRecoveryZkTest, HdfsSyncSliceTest, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, CachingDirectoryFactoryTest, TestConfigSets, TestInfoStreamLogging, TestNonNRTOpen, TestSolrXml, CoreAdminCreateDiscoverTest, TestManagedResourceStorage]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestManagedResourceStorage -Dtests.seed=FD9F9A7B0527741B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tr -Dtests.timezone=America/Kentucky/Louisville -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J0 | TestManagedResourceStorage (suite) <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: SolrCore.getOpenCount()==2
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FD9F9A7B0527741B]:0)
   [junit4]    > 	at org.apache.solr.util.TestHarness.close(TestHarness.java:332)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:630)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:182)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:724)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.rest.TestManagedResourceStorage: 
   [junit4]    >    1) Thread[id=17041, name=coreZkRegister-3177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:724)
   [junit4]    >    2) Thread[id=17039, name=Thread-3969, state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at java.lang.Object.wait(Object.java:503)
   [junit4]    >         at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
   [junit4]    >    3) Thread[id=17038, name=searcherExecutor-3182-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:724)
   [junit4]    >    4) Thread[id=17035, name=Thread-3968, state=TIMED_WAITING, group=Overseer state updater.]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at org.apache.solr.cloud.DistributedQueue$LatchChildWatcher.await(DistributedQueue.java:240)
   [junit4]    >         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:563)
   [junit4]    >         at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:527)
   [junit4]    >         at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:217)
   [junit4]    >         at java.lang.Thread.run(Thread.java:724)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FD9F9A7B0527741B]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=17041, name=coreZkRegister-3177-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:724)
   [junit4]    >    2) Thread[id=17039, name=Thread-3969, state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at java.lang.Object.wait(Object.java:503)
   [junit4]    >         at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
   [junit4]    >    3) Thread[id=17038, name=searcherExecutor-3182-thread-1, state=WAITING, group=TGRP-TestManagedResourceStorage]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:724)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FD9F9A7B0527741B]:0)
   [junit4] Completed on J0 in 27.40s, 2 tests, 3 errors <<< FAILURES!

[...truncated 101 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:1296: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java7/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 3 suite-level errors, 1 error, 228 ignored (15 assumptions)

Total time: 111 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message