lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 1575 - Failure!
Date Thu, 15 May 2014 06:13:22 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1575/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
IOException occured when talking to server at: https://127.0.0.1:49484/awholynewcollection_0

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:49484/awholynewcollection_0
	at __randomizedtesting.SeedInfo.seed([AF73F62A12DD0D9A:2E95783265826DA6]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:567)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:809)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:452)
	... 49 more




Build Log:
[...truncated 10686 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/init-core-data-001
   [junit4]   2> 182015 T1103 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 182018 T1103 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 182027 T1103 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 182028 T1103 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 182029 T1104 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 182130 T1103 oasc.ZkTestServer.run start zk server on port:49473
   [junit4]   2> 182131 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 182141 T1110 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47e146a3 name:ZooKeeperConnection Watcher:127.0.0.1:49473 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 182141 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 182141 T1103 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 182155 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 182159 T1112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45df6afe name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 182160 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 182160 T1103 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 182171 T1103 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 182177 T1103 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 182181 T1103 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 182190 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 182191 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 182199 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 182200 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 182207 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 182207 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 182213 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 182214 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 182218 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 182219 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 182224 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 182224 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 182250 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 182251 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 182266 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 182267 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 182272 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 182273 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 182278 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 182279 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 182283 T1103 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 182284 T1103 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 182294 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 182297 T1114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@355e5e05 name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 182297 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 184023 T1103 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 184796 T1103 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 184830 T1103 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49477
   [junit4]   2> 184834 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 184834 T1103 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 184835 T1103 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002
   [junit4]   2> 184835 T1103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/'
   [junit4]   2> 184874 T1103 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solr.xml
   [junit4]   2> 184890 T1103 oasc.CoreContainer.<init> New CoreContainer 1368839174
   [junit4]   2> 184891 T1103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/]
   [junit4]   2> 184892 T1103 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 184892 T1103 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 184892 T1103 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 184893 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 184893 T1103 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 184893 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 184894 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 184894 T1103 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 184894 T1103 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 184899 T1103 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 184899 T1103 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 184899 T1103 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 184900 T1103 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49473/solr
   [junit4]   2> 184900 T1103 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 184906 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 184907 T1125 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6249110b name:ZooKeeperConnection Watcher:127.0.0.1:49473 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 184907 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 184914 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 184918 T1127 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58f2e6c6 name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 184918 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 184922 T1103 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 184932 T1103 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 184940 T1103 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 184951 T1103 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 184959 T1103 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 184971 T1103 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 184975 T1103 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49477_
   [junit4]   2> 184978 T1103 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49477_
   [junit4]   2> 184986 T1103 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 184991 T1103 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 185003 T1103 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49477_
   [junit4]   2> 185004 T1103 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 185010 T1103 oasc.Overseer.start Overseer (id=91758981116329988-127.0.0.1:49477_-n_0000000000) starting
   [junit4]   2> 185020 T1103 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 185047 T1129 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 185050 T1129 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:49477_
   [junit4]   2> 185050 T1103 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 185056 T1103 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 185061 T1103 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 185069 T1128 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 185075 T1103 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 185075 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 185083 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 185086 T1132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42603aa1 name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 185087 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 185090 T1103 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 185096 T1103 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 186577 T1103 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 186578 T1103 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 186587 T1103 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 186589 T1103 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49481
   [junit4]   2> 186592 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 186593 T1103 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 186594 T1103 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003
   [junit4]   2> 186594 T1103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/'
   [junit4]   2> 186638 T1103 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solr.xml
   [junit4]   2> 186654 T1103 oasc.CoreContainer.<init> New CoreContainer 1162040275
   [junit4]   2> 186655 T1103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/]
   [junit4]   2> 186655 T1103 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 186656 T1103 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 186656 T1103 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 186656 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 186657 T1103 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 186657 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 186658 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 186658 T1103 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 186658 T1103 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 186663 T1103 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 186664 T1103 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 186664 T1103 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 186664 T1103 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49473/solr
   [junit4]   2> 186665 T1103 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 186667 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 186672 T1143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fadd776 name:ZooKeeperConnection Watcher:127.0.0.1:49473 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 186672 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 186678 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 186683 T1145 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1468dd1e name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 186684 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 186706 T1103 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 187715 T1103 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49481_
   [junit4]   2> 187718 T1103 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49481_
   [junit4]   2> 187736 T1103 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 187736 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 189237 T1103 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 189238 T1103 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 189246 T1103 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 189249 T1103 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49484
   [junit4]   2> 189252 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 189252 T1103 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 189253 T1103 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004
   [junit4]   2> 189253 T1103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/'
   [junit4]   2> 189333 T1103 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solr.xml
   [junit4]   2> 189348 T1103 oasc.CoreContainer.<init> New CoreContainer 1086686376
   [junit4]   2> 189348 T1103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/]
   [junit4]   2> 189348 T1103 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 189349 T1103 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 189349 T1103 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 189349 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 189350 T1103 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 189350 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 189350 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 189350 T1103 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 189351 T1103 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 189357 T1103 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 189357 T1103 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 189357 T1103 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 189358 T1103 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49473/solr
   [junit4]   2> 189358 T1103 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 189359 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 189364 T1157 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46b3a974 name:ZooKeeperConnection Watcher:127.0.0.1:49473 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 189364 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 189371 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 189376 T1159 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ca7f043 name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 189377 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 189396 T1103 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 190404 T1103 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49484_
   [junit4]   2> 190407 T1103 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49484_
   [junit4]   2> 190435 T1103 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 190436 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 191893 T1103 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 191894 T1103 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 191901 T1103 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 191905 T1103 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49487
   [junit4]   2> 191908 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 191908 T1103 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 191909 T1103 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005
   [junit4]   2> 191909 T1103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/'
   [junit4]   2> 191947 T1103 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solr.xml
   [junit4]   2> 192232 T1103 oasc.CoreContainer.<init> New CoreContainer 1916465403
   [junit4]   2> 192232 T1103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/]
   [junit4]   2> 192233 T1103 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 192233 T1103 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 192233 T1103 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 192234 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 192234 T1103 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 192235 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 192235 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 192238 T1103 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 192238 T1103 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 192243 T1103 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 192244 T1103 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 192244 T1103 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 192244 T1103 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49473/solr
   [junit4]   2> 192245 T1103 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 192256 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 192260 T1171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24956bb0 name:ZooKeeperConnection Watcher:127.0.0.1:49473 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 192261 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 192273 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 192276 T1173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@363acaf5 name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 192276 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 192298 T1103 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 193307 T1103 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49487_
   [junit4]   2> 193310 T1103 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49487_
   [junit4]   2> 193334 T1103 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 193335 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 194802 T1103 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 194802 T1103 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 194812 T1103 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 194814 T1103 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49490
   [junit4]   2> 194817 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 194818 T1103 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 194818 T1103 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006
   [junit4]   2> 194818 T1103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/'
   [junit4]   2> 194852 T1103 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/solr.xml
   [junit4]   2> 194870 T1103 oasc.CoreContainer.<init> New CoreContainer 602221831
   [junit4]   2> 194871 T1103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/]
   [junit4]   2> 194871 T1103 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 194872 T1103 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 194872 T1103 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 194872 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 194872 T1103 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 194873 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 194873 T1103 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 194873 T1103 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 194874 T1103 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 194879 T1103 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 194880 T1103 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 194881 T1103 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 194881 T1103 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49473/solr
   [junit4]   2> 194881 T1103 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 194883 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 194888 T1185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f43cab9 name:ZooKeeperConnection Watcher:127.0.0.1:49473 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 194888 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 194893 T1103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 194898 T1187 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1437c0bf name:ZooKeeperConnection Watcher:127.0.0.1:49473/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 194898 T1103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 194922 T1103 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 195931 T1103 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49490_
   [junit4]   2> 195934 T1103 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49490_
   [junit4]   2> 195964 T1103 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 195964 T1103 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 196568 T1140 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&router.name=compositeId&action=CREATE&numShards=2&wt=javabin&version=2
   [junit4]   2> 196571 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196573 T1129 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 196573 T1129 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 196574 T1129 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 196575 T1129 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 196578 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196582 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196586 T1128 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 196587 T1128 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 196587 T1128 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 196596 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196597 T1159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 196598 T1132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 196598 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 196599 T1145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 196598 T1173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 196598 T1187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 196685 T1129 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 196685 T1129 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:49481_
   [junit4]   2> 196689 T1129 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:49484_
   [junit4]   2> 196694 T1129 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:49487_
   [junit4]   2> 196738 T1129 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:49477_
   [junit4]   2> 196871 T1137 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 196878 T1137 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 196881 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196887 T1152 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 196889 T1137 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 196899 T1165 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 196900 T1128 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 196902 T1128 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49481",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49481_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 196903 T1152 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 196905 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196905 T1152 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 196909 T1165 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 196913 T1165 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 196916 T1118 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 196919 T1128 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49484",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49484_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 196925 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196925 T1118 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 196929 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 196929 T1118 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 196929 T1128 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49487",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49487_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 196938 T1128 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:49477",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49477_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 196943 T1127 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 197056 T1132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 197056 T1187 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 197056 T1159 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 197058 T1127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 197058 T1145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 197057 T1173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 197890 T1137 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 197892 T1137 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solr.xml
   [junit4]   2> 197892 T1137 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 197894 T1137 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 197895 T1137 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 197897 T1137 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 197898 T1137 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solrj_collection_shard1_replica1/'
   [junit4]   2> 197908 T1152 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 197914 T1165 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 197909 T1152 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solr.xml
   [junit4]   2> 197918 T1152 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 197915 T1165 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solr.xml
   [junit4]   2> 197919 T1165 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 197920 T1152 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 197921 T1152 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 197924 T1152 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 197924 T1152 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solrj_collection_shard1_replica2/'
   [junit4]   2> 197935 T1118 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 197936 T1118 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solr.xml
   [junit4]   2> 197936 T1118 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 197937 T1165 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 197937 T1165 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 197946 T1118 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 197946 T1118 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 197963 T1165 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 197963 T1165 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solrj_collection_shard2_replica1/'
   [junit4]   2> 197979 T1118 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 197980 T1118 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solrj_collection_shard2_replica2/'
   [junit4]   2> 198026 T1152 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 198040 T1137 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 198035 T1165 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 198064 T1152 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 198091 T1165 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 198092 T1152 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 198098 T1137 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 198101 T1152 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 198112 T1165 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 198121 T1165 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 198104 T1137 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 198127 T1118 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 198131 T1137 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 198160 T1118 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 198186 T1118 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 198193 T1118 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 198488 T1165 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 198500 T1152 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 198509 T1118 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 198511 T1137 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 198517 T1165 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 198518 T1165 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 198533 T1137 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 198534 T1137 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 198542 T1118 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 198543 T1118 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 198543 T1152 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 198549 T1152 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 198601 T1165 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198607 T1137 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198610 T1165 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198616 T1137 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198617 T1165 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198618 T1152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198624 T1137 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198627 T1118 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198629 T1165 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198630 T1165 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198630 T1165 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198631 T1152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198633 T1137 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198634 T1137 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198634 T1137 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198636 T1118 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 198633 T1165 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198637 T1165 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198637 T1165 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection
   [junit4]   2> 198637 T1165 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 198638 T1165 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solrj_collection_shard2_replica1/data/
   [junit4]   2> 198638 T1165 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f8307c2
   [junit4]   2> 198636 T1152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198642 T1165 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solrj_collection_shard2_replica1/data
   [junit4]   2> 198642 T1165 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 198642 T1165 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 198643 T1165 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-005/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 198644 T1165 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6645795710205248]
   [junit4]   2> 198647 T1165 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@41f47187 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3576f963),segFN=segments_1,generation=1}
   [junit4]   2> 198648 T1165 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198651 T1152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198651 T1152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198652 T1152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198654 T1137 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198654 T1137 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198654 T1137 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using configuration from collection solrj_collection
   [junit4]   2> 198655 T1137 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 198655 T1137 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solrj_collection_shard1_replica1/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solrj_collection_shard1_replica1/data/
   [junit4]   2> 198656 T1137 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f8307c2
   [junit4]   2> 198656 T1118 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198666 T1152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198667 T1152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198667 T1152 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using configuration from collection solrj_collection
   [junit4]   2> 198667 T1152 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 198668 T1152 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solrj_collection_shard1_replica2/, dataDir=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solrj_collection_shard1_replica2/data/
   [junit4]   2> 198668 T1152 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f8307c2
   [junit4]   2> 198669 T1165 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 198670 T1165 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 198671 T1165 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 198671 T1165 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198672 T1165 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198672 T1165 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 198672 T1165 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198673 T1165 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198673 T1165 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 198674 T1165 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 198680 T1165 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 198681 T1165 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 198683 T1165 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 198667 T1137 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solrj_collection_shard1_replica1/data
   [junit4]   2> 198684 T1137 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 198686 T1137 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 198687 T1137 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-003/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 198687 T1137 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6645795710205248]
   [junit4]   2> 198684 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198689 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198689 T1118 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 198689 T1152 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solrj_collection_shard1_replica2/data
   [junit4]   2> 198690 T1152 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 198690 T1152 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory './solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 198691 T1152 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-004/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 198691 T1152 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6645795710205248]
   [junit4]   2> 198689 T1165 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 198692 T1165 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 198693 T1165 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 198693 T1165 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 198697 T1137 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1d8ec3e4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@98c0cc6),segFN=segments_1,generation=1}
   [junit4]   2> 198697 T1137 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198702 T1165 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 198703 T1152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@628cee40 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ef8897c),segFN=segments_1,generation=1}
   [junit4]   2> 198703 T1152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198707 T1152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 198708 T1152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 198708 T1152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 198709 T1152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198709 T1152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198709 T1152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 198710 T1152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198710 T1152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198711 T1152 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 198712 T1152 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 198702 T1137 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 198713 T1137 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 198713 T1137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 198714 T1137 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198714 T1137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198715 T1137 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 198721 T1137 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198724 T1137 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198724 T1137 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 198713 T1152 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 198725 T1152 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 198725 T1152 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 198725 T1137 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 198723 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 198729 T1118 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 198729 T1118 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection
   [junit4]   2> 198729 T1118 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 198730 T1118 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solrj_collection_shard2_replica2/, dataDir=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solrj_collection_shard2_replica2/data/
   [junit4]   2> 198730 T1118 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7f8307c2
   [junit4]   2> 198731 T1165 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 198732 T1165 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 198732 T1165 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1042548171, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 198727 T1137 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 198733 T1137 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 198733 T1137 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 198734 T1137 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 198734 T1137 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 198735 T1137 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 198735 T1137 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 198737 T1137 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 198727 T1152 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 198738 T1152 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 198739 T1152 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 198740 T1118 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solrj_collection_shard2_replica2/data
   [junit4]   2> 198740 T1118 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 198740 T1118 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 198740 T1152 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 198743 T1152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 198744 T1118 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-002/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 198744 T1118 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6645795710205248]
   [junit4]   2> 198747 T1152 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 198748 T1152 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 198754 T1137 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 198755 T1137 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 198755 T1152 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1042548171, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 198756 T1137 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1042548171, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 198756 T1165 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@41f47187 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3576f963),segFN=segments_1,generation=1}
   [junit4]   2> 198758 T1165 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198761 T1165 oass.SolrIndexSearcher.<init> Opening Searcher@5a218f2[solrj_collection_shard2_replica1] main
   [junit4]   2> 198762 T1165 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 198763 T1137 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1d8ec3e4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@98c0cc6),segFN=segments_1,generation=1}
   [junit4]   2> 198763 T1137 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198765 T1137 oass.SolrIndexSearcher.<init> Opening Searcher@23819772[solrj_collection_shard1_replica1] main
   [junit4]   2> 198765 T1137 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 198767 T1118 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@35a3c5b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f0e296b),segFN=segments_1,generation=1}
   [junit4]   2> 198767 T1118 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198772 T1118 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 198772 T1118 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 198773 T1118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 198773 T1118 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198774 T1118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 198774 T1118 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 198775 T1118 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198775 T1118 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 198776 T1118 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 198777 T1152 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@628cee40 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ef8897c),segFN=segments_1,generation=1}
   [junit4]   2> 198777 T1152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198778 T1152 oass.SolrIndexSearcher.<init> Opening Searcher@765034e6[solrj_collection_shard1_replica2] main
   [junit4]   2> 198778 T1152 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 198776 T1118 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 198779 T1118 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 198780 T1118 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 198780 T1118 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 198781 T1118 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 198781 T1118 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 198782 T1118 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 198783 T1118 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 198783 T1165 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 198784 T1165 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 198785 T1118 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 198789 T1137 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 198790 T1137 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 198792 T1137 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 198792 T1118 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 198792 T1152 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 198793 T1152 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 198792 T1137 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 198793 T1137 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 198792 T1165 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 198794 T1165 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 198794 T1165 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 198792 T1118 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 198803 T1118 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1042548171, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 198805 T1165 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 198805 T1165 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 198806 T1165 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 198806 T1165 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 198806 T1118 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@35a3c5b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f0e296b),segFN=segments_1,generation=1}
   [junit4]   2> 198809 T1118 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 198810 T1118 oass.SolrIndexSearcher.<init> Opening Searcher@2de18aa4[solrj_collection_shard2_replica2] main
   [junit4]   2> 198810 T1118 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 198805 T1152 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 198811 T1152 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 198811 T1152 oasr.ManagedResourceStorage.load Reading _rest_managed.json using Zo

[...truncated too long message...]

  2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
   [junit4]   2> 		... 7 more
   [junit4]   2> 	
   [junit4]   2> 430937 T1145 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 430937 T1145 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 430937 T1145 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 430937 T1145 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 430937 T1145 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 430938 T1145 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 431207 T1187 C193 P49490 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
   [junit4]   2> 431207 T1187 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
   [junit4]   2> 431208 T1187 oasc.SolrCore.close [awholynewcollection_0_shard1_replica3]  CLOSING SolrCore org.apache.solr.core.SolrCore@42ce115e
   [junit4]   2> 431216 T1187 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=3,adds=3,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 431217 T1187 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 431217 T1187 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 431217 T1187 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 431217 T1187 C193 P49490 oasu.DirectUpdateHandler2.closeWriter Committing on IndexWriter close.
   [junit4]   2> 431226 T1187 C193 P49490 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@698ec9a1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7e09a689),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@698ec9a1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7e09a689),segFN=segments_2,generation=2}
   [junit4]   2> 431227 T1187 C193 P49490 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 431228 T1187 oasc.SolrCore.closeSearcher [awholynewcollection_0_shard1_replica3] Closing main searcher on request.
   [junit4]   2> 431228 T1187 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 431228 T1187 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/awholynewcollection_0_shard1_replica3/data [CachedDir<<refCount=0;path=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/awholynewcollection_0_shard1_replica3/data;done=false>>]
   [junit4]   2> 431228 T1187 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/awholynewcollection_0_shard1_replica3/data
   [junit4]   2> 431229 T1187 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/awholynewcollection_0_shard1_replica3/data/index [CachedDir<<refCount=0;path=./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/awholynewcollection_0_shard1_replica3/data/index;done=false>>]
   [junit4]   2> 431229 T1187 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001/tempDir-006/awholynewcollection_0_shard1_replica3/data/index
   [junit4]   2> 431229 T1187 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 431232 T1187 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solr.cloud.CollectionsAPIDistributedZkTest-AF73F62A12DD0D9A-001
   [junit4]   2> NOTE: test params are: codec=Lucene46: {other_tl1=Lucene41(blocksize=128), _version_=Lucene41(blocksize=128), multiDefault=PostingsFormat(name=MockRandom), a_t=Lucene41(blocksize=128), intDefault=Lucene41(blocksize=128), a_i1=Lucene41(blocksize=128), id=Pulsing41(freqCutoff=9 minBlockSize=49 maxBlockSize=183), text=PostingsFormat(name=Lucene41VarGapFixedInterval), range_facet_l=Lucene41(blocksize=128), timestamp=Lucene41(blocksize=128)}, docValues:{timestamp=DocValuesFormat(name=Lucene45)}, sim=DefaultSimilarity, locale=ar_AE, timezone=Europe/Andorra
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=2,threads=1,free=97436704,total=243793920
   [junit4]   2> NOTE: All tests run in this JVM: [PathHierarchyTokenizerFactoryTest, StatsComponentTest, SpatialFilterTest, CurrencyFieldXmlFileTest, RequestHandlersTest, ChaosMonkeySafeLeaderTest, MinimalSchemaTest, FieldAnalysisRequestHandlerTest, SampleTest, TestReplicationHandler, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 249.30s, 1 test, 1 error <<< FAILURES!

[...truncated 1204 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:447: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:45: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:496: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1296: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:920: There were test failures: 403 suites, 1681 tests, 1 error, 42 ignored (15 assumptions)

Total time: 95 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message