lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_31) - Build # 4487 - Still Failing!
Date Sat, 14 Feb 2015 23:54:45 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4487/
Java: 32bit/jdk1.8.0_31 -client -XX:+UseParallelGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandlerBackup

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1\data: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1\data    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1\data: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1\data    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001 

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1\data: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1\data
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1\data: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1\data
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001

	at __randomizedtesting.SeedInfo.seed([F9927499153FFFFA]:0)
	at org.apache.lucene.util.IOUtils.rm(IOUtils.java:286)
	at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:170)
	at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZk2Test

Error Message:
Could not remove the following files (in the order of attempts):    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-002: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-002    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001 

Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-002: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-002
   C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001

	at __randomizedtesting.SeedInfo.seed([F9927499153FFFFA]:0)
	at org.apache.lucene.util.IOUtils.rm(IOUtils.java:286)
	at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:170)
	at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.ReplicationFactorTest.test

Error Message:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:58219/repfacttest_c8n_1x3_shard1_replica1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:58219/repfacttest_c8n_1x3_shard1_replica1
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:575)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:884)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:787)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:730)
	at org.apache.solr.cloud.ReplicationFactorTest.testRf3(ReplicationFactorTest.java:284)
	at org.apache.solr.cloud.ReplicationFactorTest.test(ReplicationFactorTest.java:112)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:940)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:915)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:58219/repfacttest_c8n_1x3_shard1_replica1
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:573)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:214)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:210)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:370)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:572)
	... 47 more
Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:464)
	... 52 more




Build Log:
[...truncated 9202 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\init-core-data-001
   [junit4]   2> 932830 T3940 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 932838 T3940 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 932839 T3941 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 932948 T3940 oasc.ZkTestServer.run start zk server on port:51243
   [junit4]   2> 932949 T3940 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 932957 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 932967 T3948 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dc5b96 name:ZooKeeperConnection Watcher:127.0.0.1:51243 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 932967 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 932969 T3940 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 932971 T3940 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 932983 T3940 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 932987 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 932993 T3951 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@da17f0 name:ZooKeeperConnection Watcher:127.0.0.1:51243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 932994 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 932995 T3940 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 932995 T3940 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 933004 T3940 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 933016 T3940 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 933026 T3940 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 933035 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 933036 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 933045 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 933047 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 933055 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 933056 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 933067 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 933067 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 933073 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 933073 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 933082 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 933082 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 933089 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 933090 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 933097 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 933097 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 933104 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 933104 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 933113 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 933113 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 933122 T3940 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 933122 T3940 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 935513 T3940 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\cores\collection1
   [junit4]   2> 935526 T3940 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 935532 T3940 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@6c963e{/,null,AVAILABLE}
   [junit4]   2> 935537 T3940 oejs.AbstractConnector.doStart Started ServerConnector@fb04ef{HTTP/1.1}{127.0.0.1:51250}
   [junit4]   2> 935540 T3940 oejs.Server.doStart Started @935988ms
   [junit4]   2> 935542 T3940 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@387f44
   [junit4]   2> 935543 T3940 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 935544 T3940 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001
   [junit4]   2> 935545 T3940 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\'
   [junit4]   2> 935621 T3940 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\solr.xml
   [junit4]   2> 935640 T3940 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\cores
   [junit4]   2> 935641 T3940 oasc.CoreContainer.<init> New CoreContainer 32558338
   [junit4]   2> 935641 T3940 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\]
   [junit4]   2> 935643 T3940 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 935643 T3940 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 935643 T3940 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 935644 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 935644 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 935644 T3940 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 935645 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 935645 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 935645 T3940 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 935646 T3940 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 935646 T3940 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 935648 T3940 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 935648 T3940 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 935648 T3940 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 935649 T3940 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 935649 T3940 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51243/solr
   [junit4]   2> 935650 T3940 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 935650 T3940 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 935654 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 935662 T3965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@da5f90 name:ZooKeeperConnection Watcher:127.0.0.1:51243 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 935665 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 935665 T3940 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 935671 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 935685 T3968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62ea6b name:ZooKeeperConnection Watcher:127.0.0.1:51243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 935686 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 935690 T3940 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 935700 T3940 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 935711 T3940 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 935721 T3940 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 935729 T3940 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 935736 T3940 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 935740 T3940 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51250_
   [junit4]   2> 935743 T3940 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51250_
   [junit4]   2> 935749 T3940 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 935755 T3940 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 935761 T3940 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 935764 T3940 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51250_
   [junit4]   2> 935765 T3940 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 935768 T3940 oasc.Overseer.start Overseer (id=93320214384148483-127.0.0.1:51250_-n_0000000000) starting
   [junit4]   2> 935775 T3940 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 935802 T3940 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 935806 T3970 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 935810 T3940 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 935818 T3940 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 935823 T3940 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 935835 T3969 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 935836 T3940 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\cores
   [junit4]   2> 935838 T3940 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\cores\collection1\
   [junit4]   2> 935838 T3940 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 935842 T3972 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 935842 T3972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 935844 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 935845 T3972 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 935855 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51250",
   [junit4]   2> 	  "node_name":"127.0.0.1:51250_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 935861 T3969 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51250",
   [junit4]   2> 	  "node_name":"127.0.0.1:51250_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 935861 T3969 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 935861 T3969 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 935866 T3968 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 936941 T3972 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 936941 T3972 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 936945 T3972 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 936945 T3972 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 936949 T3972 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 936950 T3972 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\cores\collection1\'
   [junit4]   2> 936992 T3972 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 937000 T3972 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 937018 T3972 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 937027 T3972 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 937037 T3972 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 937043 T3972 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 937066 T3972 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 937236 T3972 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 937249 T3972 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 937252 T3972 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 937277 T3972 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 937283 T3972 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 937291 T3972 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 937293 T3972 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 937294 T3972 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 937294 T3972 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 937297 T3972 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 937297 T3972 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 937297 T3972 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 937297 T3972 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 937298 T3972 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\control-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/control/data\
   [junit4]   2> 937298 T3972 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a4cfdf
   [junit4]   2> 937299 T3972 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/control/data\
   [junit4]   2> 937299 T3972 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/control/data\index/
   [junit4]   2> 937299 T3972 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 937300 T3972 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/control/data\index
   [junit4]   2> 937301 T3972 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=89.8525390625, floorSegmentMB=1.3876953125, forceMergeDeletesPctAllowed=6.437468219574429, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 937301 T3972 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af4670 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f03c8),segFN=segments_1,generation=1}
   [junit4]   2> 937301 T3972 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 937307 T3972 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 937308 T3972 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 937308 T3972 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 937309 T3972 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 937309 T3972 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 937310 T3972 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 937311 T3972 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 937312 T3972 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 937312 T3972 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 937317 T3972 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 937318 T3972 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 937319 T3972 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 937320 T3972 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 937321 T3972 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 937322 T3972 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 937324 T3972 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 937325 T3972 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 937326 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 937328 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 937328 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 937329 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 937330 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 937331 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 937331 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 937332 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 937332 T3972 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 937333 T3972 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 937340 T3972 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 937343 T3972 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 937345 T3972 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 937348 T3972 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 937349 T3972 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 937353 T3972 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 937354 T3972 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 937355 T3972 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=84.8662109375, floorSegmentMB=0.99609375, forceMergeDeletesPctAllowed=19.63360025878368, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2235959029688507
   [junit4]   2> 937357 T3972 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af4670 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f03c8),segFN=segments_1,generation=1}
   [junit4]   2> 937357 T3972 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 937358 T3972 oass.SolrIndexSearcher.<init> Opening Searcher@17ce0ec[collection1] main
   [junit4]   2> 937358 T3972 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 937361 T3972 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 937361 T3972 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 937364 T3972 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 937364 T3972 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 937364 T3972 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 937366 T3972 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 937366 T3972 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 937366 T3972 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 937366 T3972 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 937369 T3973 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17ce0ec[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 937370 T3972 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 937373 T3976 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51250 collection:control_collection shard:shard1
   [junit4]   2> 937374 T3940 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 937375 T3940 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 937376 T3940 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 937376 T3976 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 937378 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 937387 T3976 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 937390 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 937392 T3976 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 937392 T3976 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C486 name=collection1 org.apache.solr.core.SolrCore@1430bc8 url=http://127.0.0.1:51250/collection1 node=127.0.0.1:51250_ C486_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:51250, node_name=127.0.0.1:51250_, state=down}
   [junit4]   2> 937392 T3976 C486 P51250 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51250/collection1/
   [junit4]   2> 937394 T3979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aad92e name:ZooKeeperConnection Watcher:127.0.0.1:51243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 937395 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 937395 T3940 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 937400 T3976 C486 P51250 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 937400 T3976 C486 P51250 oasc.SyncStrategy.syncToMe http://127.0.0.1:51250/collection1/ has no replicas
   [junit4]   2> 937400 T3976 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51250/collection1/ shard1
   [junit4]   2> 937401 T3976 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 937403 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 937404 T3940 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 937424 T3940 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 937427 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 937430 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51250",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 1
   [junit4]   2> 937434 T3968 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 937436 T3979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 937580 T3976 oasc.ZkController.register We are http://127.0.0.1:51250/collection1/ and leader is http://127.0.0.1:51250/collection1/
   [junit4]   2> 937580 T3976 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51250
   [junit4]   2> 937580 T3976 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 937580 T3976 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 937581 T3976 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 937588 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 937601 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51250",
   [junit4]   2> 	  "node_name":"127.0.0.1:51250_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 2
   [junit4]   2> 937602 T3969 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51250",
   [junit4]   2> 	  "node_name":"127.0.0.1:51250_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 937706 T3979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 937707 T3968 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 939478 T3940 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\cores\collection1
   [junit4]   2> 939482 T3940 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 939484 T3940 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 939495 T3940 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@1c26aac{/,null,AVAILABLE}
   [junit4]   2> 939501 T3940 oejs.AbstractConnector.doStart Started ServerConnector@120eb9e{HTTP/1.1}{127.0.0.1:51262}
   [junit4]   2> 939502 T3940 oejs.Server.doStart Started @940002ms
   [junit4]   2> 939502 T3940 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@387f44
   [junit4]   2> 939502 T3940 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 939502 T3940 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001
   [junit4]   2> 939504 T3940 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\'
   [junit4]   2> 939573 T3940 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\solr.xml
   [junit4]   2> 939587 T3940 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\cores
   [junit4]   2> 939588 T3940 oasc.CoreContainer.<init> New CoreContainer 13250602
   [junit4]   2> 939589 T3940 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\]
   [junit4]   2> 939590 T3940 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 939590 T3940 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 939590 T3940 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 939590 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 939590 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 939592 T3940 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 939593 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 939593 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 939593 T3940 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 939594 T3940 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 939594 T3940 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 939594 T3940 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 939596 T3940 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 939596 T3940 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 939596 T3940 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 939597 T3940 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51243/solr
   [junit4]   2> 939597 T3940 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 939597 T3940 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 939600 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 939609 T3993 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24c30a name:ZooKeeperConnection Watcher:127.0.0.1:51243 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 939610 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 939610 T3940 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 939617 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 939620 T3996 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bf62c9 name:ZooKeeperConnection Watcher:127.0.0.1:51243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 939620 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 939635 T3940 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 940633 T3940 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51262_
   [junit4]   2> 940636 T3940 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51262_
   [junit4]   2> 940651 T3940 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 940657 T3940 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\cores
   [junit4]   2> 940660 T3940 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\cores\collection1\
   [junit4]   2> 940660 T3940 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 940666 T3997 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 940666 T3997 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 940667 T3997 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 940668 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 940679 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51262",
   [junit4]   2> 	  "node_name":"127.0.0.1:51262_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 940681 T3969 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51262",
   [junit4]   2> 	  "node_name":"127.0.0.1:51262_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 940681 T3969 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 940681 T3969 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 940684 T3996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 940685 T3968 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 940685 T3979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 941655 T3997 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 941655 T3997 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 941657 T3997 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 941657 T3997 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 941660 T3997 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 941660 T3997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\cores\collection1\'
   [junit4]   2> 941720 T3997 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 941726 T3997 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 941748 T3997 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 941752 T3997 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 941773 T3997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 941777 T3997 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 941791 T3997 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 941972 T3997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 941983 T3997 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 941988 T3997 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 942019 T3997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 942029 T3997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 942035 T3997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 942038 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 942038 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 942038 T3997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 942040 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 942040 T3997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 942040 T3997 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 942040 T3997 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 942041 T3997 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-1-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/jetty1\
   [junit4]   2> 942041 T3997 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@a4cfdf
   [junit4]   2> 942042 T3997 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/jetty1\
   [junit4]   2> 942042 T3997 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/jetty1\index/
   [junit4]   2> 942042 T3997 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 942042 T3997 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\tempDir-001/jetty1\index
   [junit4]   2> 942044 T3997 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=89.8525390625, floorSegmentMB=1.3876953125, forceMergeDeletesPctAllowed=6.437468219574429, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 942045 T3997 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1201918 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@637e38),segFN=segments_1,generation=1}
   [junit4]   2> 942046 T3997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 942054 T3997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 942055 T3997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 942055 T3997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 942055 T3997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 942056 T3997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 942056 T3997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 942057 T3997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 942057 T3997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 942057 T3997 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 942059 T3997 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 942060 T3997 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 942062 T3997 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 942063 T3997 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 942063 T3997 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 942065 T3997 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 942068 T3997 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 942070 T3997 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 942075 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 942080 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 942081 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 942082 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 942083 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 942089 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 942090 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 942091 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 942092 T3997 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 942095 T3997 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 942103 T3997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 942106 T3997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 942109 T3997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 942113 T3997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 942113 T3997 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 942119 T3997 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 942119 T3997 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 942121 T3997 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=84.8662109375, floorSegmentMB=0.99609375, forceMergeDeletesPctAllowed=19.63360025878368, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2235959029688507
   [junit4]   2> 942122 T3997 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1201918 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@637e38),segFN=segments_1,generation=1}
   [junit4]   2> 942122 T3997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 942123 T3997 oass.SolrIndexSearcher.<init> Opening Searcher@1b6f2cb[collection1] main
   [junit4]   2> 942123 T3997 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 942125 T3997 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 942125 T3997 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 942127 T3997 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 942127 T3997 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 942127 T3997 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 942130 T3997 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 942130 T3997 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 942130 T3997 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 942130 T3997 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 942131 T3997 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 942135 T3940 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 942135 T3940 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 942141 T4001 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51262 collection:collection1 shard:shard2
   [junit4]   2> 942149 T3998 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b6f2cb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 942154 T4001 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 942170 T4001 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 942176 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 942179 T4001 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 942179 T4001 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C487 name=collection1 org.apache.solr.core.SolrCore@19d7801 url=http://127.0.0.1:51262/collection1 node=127.0.0.1:51262_ C487_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:51262, node_name=127.0.0.1:51262_, state=down}
   [junit4]   2> 942180 T4001 C487 P51262 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51262/collection1/
   [junit4]   2> 942180 T4001 C487 P51262 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 942180 T4001 C487 P51262 oasc.SyncStrategy.syncToMe http://127.0.0.1:51262/collection1/ has no replicas
   [junit4]   2> 942180 T4001 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51262/collection1/ shard2
   [junit4]   2> 942182 T4001 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 942186 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 942193 T3996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 942194 T3979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 942197 T3968 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 942229 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51262",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 5
   [junit4]   2> 942239 T4002 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 942241 T3979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 942243 T3996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 942279 T4001 oasc.ZkController.register We are http://127.0.0.1:51262/collection1/ and leader is http://127.0.0.1:51262/collection1/
   [junit4]   2> 942280 T4001 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51262
   [junit4]   2> 942280 T4001 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 942280 T4001 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 942281 T4001 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 942293 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 942300 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51262",
   [junit4]   2> 	  "node_name":"127.0.0.1:51262_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 6
   [junit4]   2> 942302 T3969 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51262",
   [junit4]   2> 	  "node_name":"127.0.0.1:51262_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 942416 T3979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 942417 T3968 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 942418 T3996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 944274 T3940 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001\cores\collection1
   [junit4]   2> 944279 T3940 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 944281 T3940 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 944286 T3940 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@13b5ca5{/,null,AVAILABLE}
   [junit4]   2> 944288 T3940 oejs.AbstractConnector.doStart Started ServerConnector@ab4252{HTTP/1.1}{127.0.0.1:51271}
   [junit4]   2> 944289 T3940 oejs.Server.doStart Started @944958ms
   [junit4]   2> 944290 T3940 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@387f44
   [junit4]   2> 944292 T3940 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 944293 T3940 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001
   [junit4]   2> 944294 T3940 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001\'
   [junit4]   2> 944364 T3940 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001\solr.xml
   [junit4]   2> 944379 T3940 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001\cores
   [junit4]   2> 944381 T3940 oasc.CoreContainer.<init> New CoreContainer 937457
   [junit4]   2> 944381 T3940 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001\]
   [junit4]   2> 944382 T3940 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 944383 T3940 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 944384 T3940 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 944384 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 944385 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 944385 T3940 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 944386 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 944387 T3940 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 944387 T3940 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 944388 T3940 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 944388 T3940 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
   [junit4]   2> 944389 T3940 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 944390 T3940 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 944390 T3940 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 944391 T3940 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 944392 T3940 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51243/solr
   [junit4]   2> 944392 T3940 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 944393 T3940 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 944396 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 944402 T4016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10e407c name:ZooKeeperConnection Watcher:127.0.0.1:51243 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 944405 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 944405 T3940 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 944412 T3940 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 944422 T4019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15eeaae name:ZooKeeperConnection Watcher:127.0.0.1:51243/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 944423 T3940 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 944438 T3940 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 945434 T3940 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51271_
   [junit4]   2> 945437 T3940 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51271_
   [junit4]   2> 945457 T3940 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 945461 T3940 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001\cores
   [junit4]   2> 945461 T3940 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZk2Test F9927499153FFFFA-001\shard-2-001\cores\collection1\
   [junit4]   2> 945461 T3940 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 945462 T4020 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 945462 T4020 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 945464 T4020 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 945466 T3968 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 945470 T3969 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51271",
   [junit4]   2> 	  "node_name":"127.0.0.1:51271_",
   [junit4]   2> 	  "numS

[...truncated too long message...]

FieldMutatingUpdateProcessorTest, SyncSliceTest, OutputWriterTest, TestOmitPositions, ShowFileRequestHandlerTest, TestBM25SimilarityFactory, CachingDirectoryFactoryTest, TestQueryUtils, SuggesterWFSTTest, LoggingHandlerTest, TestDistributedMissingSort, TestHighlightDedupGrouping, TestFileDictionaryLookup, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, TestHashPartitioner, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestRangeQuery, TestCoreContainer, TestSolr4Spatial, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, TestGroupingSearch, BadIndexSchemaTest, DirectUpdateHandlerTest, OverseerCollectionProcessorTest, HighlighterTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SuggesterFSTTest, SolrRequestParserTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, TestStressLucene, TestTrie, TestCSVLoader, PolyFieldTest, NoCacheHeaderTest, SolrCoreCheckLockOnStartupTest, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, TestRemoteStreaming, DocValuesMultiTest, DebugComponentTest, CacheHeaderTest, TestSurroundQueryParser, LukeRequestHandlerTest, DisMaxRequestHandlerTest, StandardRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, PrimitiveFieldTypeTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestArbitraryIndexDir, FastVectorHighlighterTest, SolrPluginUtilsTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, QueryParsingTest, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, SearchHandlerTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, CopyFieldTest, ResponseLogComponentTest, SolrIndexConfigTest, BadComponentTest, TestSolrDeletionPolicy2, SampleTest, TestDocSet, TestBinaryField, TestSearchPerf, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestPhraseSuggestions, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestLMDirichletSimilarityFactory, TestFastWriter, ResourceLoaderTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, PrimUtilsTest, TestSuggestSpellingConverter, RAMDirectoryFactoryTest, TestLRUCache, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, FileUtilsTest, TestRTGBase, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestTolerantSearch, AssignTest, CloudExitableDirectoryReaderTest, CustomCollectionTest, DistribCursorPagingTest, DistributedQueueTest, MultiThreadedOCPTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerRolesTest, RecoveryAfterSoftCommitTest, RemoteQueryErrorTest, ReplicationFactorTest, SSLMigrationTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverTest, SharedFSAutoReplicaFailoverUtilsTest, TestCloudPivotFacet, TestCollectionAPI, TestLeaderElectionZkExpiry, TestRebalanceLeaders, TestRequestStatusCollectionAPI, TriLevelCompositeIdRoutingTest, HdfsSyncSliceTest, HdfsWriteToMultipleCollectionsTest, TestClusterStateMutator, HdfsDirectoryFactoryTest, QueryResultKeyTest, TestConfigOverlay, TestImplicitCoreProperties, TestInitParams, TestNRTOpen, TestShardHandlerFactory, TestSolrConfigHandler, TestSolrDynamicMBean, TestSolrXml, TestBlobHandler, TestReplicationHandlerBackup]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandlerBackup -Dtests.seed=F9927499153FFFFA -Dtests.slow=true -Dtests.locale=fr_BE -Dtests.timezone=Asia/Omsk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s | TestReplicationHandlerBackup (suite) <<<
   [junit4]    > Throwable #1: java.io.IOException: Could not remove the following files (in the order of attempts):
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1\data: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001\collection1\data
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-001
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1\data: java.nio.file.AccessDeniedException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002\collection1\data
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001\solr-instance-002
   [junit4]    >    C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001: java.nio.file.DirectoryNotEmptyException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestReplicationHandlerBackup F9927499153FFFFA-001
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F9927499153FFFFA]:0)
   [junit4]    > 	at org.apache.lucene.util.IOUtils.rm(IOUtils.java:286)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4] Completed in 7.52s, 2 tests, 1 error <<< FAILURES!

[...truncated 206 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:519: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:191: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:509: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1349: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:957: There were test failures: 466 suites, 1861 tests, 2 suite-level errors, 1 error, 55 ignored (30 assumptions)

Total time: 124 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_31 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message