lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-Linux (32bit/jdk1.8.0_20-ea-b15) - Build # 10436 - Still Failing!
Date Sat, 14 Jun 2014 03:57:42 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/10436/
Java: 32bit/jdk1.8.0_20-ea-b15 -client -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
deletecollection the collection error [Watcher fired on path: null state: SyncConnected type None]

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: deletecollection the collection error [Watcher fired on path: null state: SyncConnected type None]
	at __randomizedtesting.SeedInfo.seed([3745085B85211730:B6A38643F27E770C]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:850)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:205)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11385 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/init-core-data-001
   [junit4]   2> 884571 T2521 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 884572 T2521 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 884578 T2521 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 884579 T2521 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 884580 T2522 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 884680 T2521 oasc.ZkTestServer.run start zk server on port:36238
   [junit4]   2> 884681 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 884685 T2528 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@164cc37 name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 884686 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 884686 T2521 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 884694 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 884698 T2530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@674876 name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 884699 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 884699 T2521 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 884703 T2521 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 884706 T2521 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 884709 T2521 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 884712 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 884712 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 884718 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 884719 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 884722 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 884723 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 884726 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 884726 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 884729 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 884730 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 884733 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 884733 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 884737 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 884737 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 884789 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 884790 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 884793 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 884793 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 884797 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 884797 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 884802 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 884803 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> Using new style solr.xml
   [junit4]   2> 884808 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 884810 T2532 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dc4abd name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 884811 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 884812 T2521 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 884828 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 884831 T2534 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bdbd5c name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 884831 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 884832 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 884833 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 884844 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 884844 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 884848 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 884849 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 884852 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 884852 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 884855 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 884856 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 884859 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 884860 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 884862 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 884863 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 884866 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 884867 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 884870 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 884871 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 884873 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 884874 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 884878 T2521 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 884878 T2521 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 885227 T2521 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 885231 T2521 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59603
   [junit4]   2> 885232 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 885233 T2521 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 885234 T2521 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-002
   [junit4]   2> 885235 T2521 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-002/'
   [junit4]   2> 885259 T2521 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-002/solr.xml
   [junit4]   2> 885287 T2521 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-002
   [junit4]   2> 885288 T2521 oasc.CoreContainer.<init> New CoreContainer 20903743
   [junit4]   2> 885288 T2521 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-002/]
   [junit4]   2> 885290 T2521 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 885291 T2521 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 885291 T2521 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 885291 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 885292 T2521 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 885292 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 885293 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 885293 T2521 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 885293 T2521 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 885294 T2521 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 885294 T2521 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 885295 T2521 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 885295 T2521 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 885295 T2521 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 885296 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 885298 T2545 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@102ee19 name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 885298 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 885301 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 885302 T2547 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@102f7bf name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 885302 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 885304 T2521 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 885307 T2521 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 885310 T2521 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 885313 T2521 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 885316 T2521 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 885319 T2521 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 885321 T2521 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59603_
   [junit4]   2> 885323 T2521 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59603_
   [junit4]   2> 885327 T2521 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 885329 T2521 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 885333 T2521 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59603_
   [junit4]   2> 885333 T2521 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 885335 T2521 oasc.Overseer.start Overseer (id=91928463879569413-127.0.0.1:59603_-n_0000000000) starting
   [junit4]   2> 885338 T2521 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 885354 T2549 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 885354 T2521 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 885357 T2521 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 885359 T2521 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 885363 T2548 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 885367 T2521 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-002
   [junit4]   2> 885375 T2521 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-002/conf/
   [junit4]   2> 885500 T2521 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 885502 T2521 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 885502 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 885503 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 885505 T2552 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7261b7 name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 885506 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 885507 T2521 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 885510 T2521 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 885827 T2521 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 885828 T2521 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 885830 T2521 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59372
   [junit4]   2> 885831 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 885831 T2521 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 885832 T2521 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003
   [junit4]   2> 885832 T2521 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/'
   [junit4]   2> 885859 T2521 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solr.xml
   [junit4]   2> 885877 T2521 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003
   [junit4]   2> 885878 T2521 oasc.CoreContainer.<init> New CoreContainer 32566723
   [junit4]   2> 885878 T2521 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/]
   [junit4]   2> 885880 T2521 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 885880 T2521 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 885881 T2521 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 885881 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 885881 T2521 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 885882 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 885882 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 885883 T2521 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 885883 T2521 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 885884 T2521 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 885884 T2521 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 885884 T2521 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 885885 T2521 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 885885 T2521 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 885886 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 885888 T2563 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ea4dbf name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 885888 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 885892 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 885894 T2565 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14f1d52 name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 885894 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 885904 T2521 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 886908 T2521 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59372_
   [junit4]   2> 886909 T2521 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59372_
   [junit4]   2> 886912 T2547 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 886912 T2552 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 886912 T2565 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 886919 T2521 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003
   [junit4]   2> 886926 T2521 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/conf/
   [junit4]   2> 887039 T2521 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 887042 T2521 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 887042 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 887348 T2521 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 887349 T2521 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 887351 T2521 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58823
   [junit4]   2> 887352 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 887352 T2521 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 887353 T2521 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004
   [junit4]   2> 887353 T2521 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/'
   [junit4]   2> 887377 T2521 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solr.xml
   [junit4]   2> 887401 T2521 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004
   [junit4]   2> 887402 T2521 oasc.CoreContainer.<init> New CoreContainer 19858335
   [junit4]   2> 887402 T2521 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/]
   [junit4]   2> 887403 T2521 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 887403 T2521 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 887403 T2521 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 887404 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 887404 T2521 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 887404 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 887405 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 887405 T2521 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 887406 T2521 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 887406 T2521 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 887407 T2521 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 887407 T2521 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 887407 T2521 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 887408 T2521 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 887409 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 887411 T2577 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@588ed0 name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 887411 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 887413 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 887415 T2579 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bca30e name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 887415 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 887422 T2521 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 888426 T2521 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58823_
   [junit4]   2> 888427 T2521 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58823_
   [junit4]   2> 888431 T2565 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 888431 T2579 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 888431 T2547 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 888431 T2552 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 888435 T2521 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004
   [junit4]   2> 888443 T2521 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/conf/
   [junit4]   2> 888554 T2521 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 888555 T2521 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 888555 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 888878 T2521 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 888879 T2521 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 888882 T2521 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59140
   [junit4]   2> 888883 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 888883 T2521 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 888883 T2521 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005
   [junit4]   2> 888884 T2521 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/'
   [junit4]   2> 888907 T2521 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solr.xml
   [junit4]   2> 888930 T2521 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005
   [junit4]   2> 888932 T2521 oasc.CoreContainer.<init> New CoreContainer 1114860
   [junit4]   2> 888932 T2521 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/]
   [junit4]   2> 888933 T2521 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 888933 T2521 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 888934 T2521 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 888934 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 888935 T2521 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 888935 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 888935 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 888936 T2521 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 888936 T2521 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 888937 T2521 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 888937 T2521 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 888938 T2521 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 888938 T2521 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 888938 T2521 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 888939 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 888941 T2591 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1caee72 name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 888941 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 888943 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 888945 T2593 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c5fb2 name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 888945 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 888952 T2521 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 889955 T2521 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59140_
   [junit4]   2> 889957 T2521 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59140_
   [junit4]   2> 889960 T2547 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 889960 T2565 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 889960 T2593 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 889960 T2579 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 889960 T2552 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 889964 T2521 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005
   [junit4]   2> 889972 T2521 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/conf/
   [junit4]   2> 890103 T2521 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 890104 T2521 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 890105 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 890404 T2521 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 890405 T2521 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 890408 T2521 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58859
   [junit4]   2> 890409 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 890409 T2521 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 890410 T2521 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006
   [junit4]   2> 890410 T2521 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/'
   [junit4]   2> 890430 T2521 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solr.xml
   [junit4]   2> 890454 T2521 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006
   [junit4]   2> 890455 T2521 oasc.CoreContainer.<init> New CoreContainer 12666054
   [junit4]   2> 890455 T2521 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/]
   [junit4]   2> 890456 T2521 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 890457 T2521 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 890457 T2521 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 890458 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 890458 T2521 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 890459 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 890459 T2521 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 890460 T2521 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 890460 T2521 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 890461 T2521 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 890461 T2521 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 890462 T2521 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 890462 T2521 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 890462 T2521 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 890463 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 890465 T2605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14384df name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 890465 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 890467 T2521 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 890468 T2607 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e084b name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 890469 T2521 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 890475 T2521 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 891479 T2521 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58859_
   [junit4]   2> 891483 T2521 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58859_
   [junit4]   2> 891498 T2547 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 891499 T2565 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 891499 T2593 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 891498 T2552 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 891499 T2607 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 891499 T2579 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 891503 T2521 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006
   [junit4]   2> 891518 T2521 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/conf/
   [junit4]   2> 891659 T2521 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 891662 T2521 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 891665 T2521 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 891683 T2558 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&router.name=compositeId&action=CREATE&numShards=2&wt=javabin&version=2
   [junit4]   2> 891686 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891687 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891687 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891688 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891688 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891689 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891689 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891691 T2549 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 891693 T2609 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 891694 T2609 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 891695 T2609 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 891703 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891706 T2548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 891707 T2548 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 891708 T2548 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 891713 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891714 T2607 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891715 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891714 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891715 T2565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891714 T2552 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891715 T2593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891803 T2609 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection solrj_collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 891804 T2609 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:59372_
   [junit4]   2> 891806 T2609 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:58859_
   [junit4]   2> 891808 T2609 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:58823_
   [junit4]   2> 891809 T2609 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:59140_
   [junit4]   2> 891813 T2561 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 891813 T2572 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica1&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 891813 T2600 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard1_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard1&wt=javabin&version=2
   [junit4]   2> 891817 T2561 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 891817 T2588 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=solrj_collection_shard2_replica2&action=CREATE&numShards=2&collection=solrj_collection&shard=shard2&wt=javabin&version=2
   [junit4]   2> 891818 T2600 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 891818 T2572 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 891820 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891822 T2561 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 891823 T2600 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 891824 T2588 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 891823 T2572 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 891826 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891826 T2588 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 891827 T2548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 891829 T2548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59372",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59372_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 891839 T2548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58859",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58859_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 891841 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891843 T2548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58823",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58823_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 891846 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891847 T2548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59140",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59140_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 891849 T2547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 891953 T2607 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891953 T2593 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891953 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891953 T2579 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891953 T2552 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 891953 T2565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 892823 T2561 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 892824 T2561 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 892824 T2600 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 892825 T2561 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 892825 T2600 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 892825 T2561 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 892826 T2572 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 892826 T2600 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 892827 T2600 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 892827 T2572 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 892828 T2588 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 892828 T2561 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 892828 T2600 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 892829 T2588 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 892829 T2572 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 892830 T2572 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 892829 T2561 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solrj_collection_shard1_replica1/'
   [junit4]   2> 892830 T2588 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 892831 T2588 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 892829 T2600 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solrj_collection_shard1_replica2/'
   [junit4]   2> 892835 T2572 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 892835 T2572 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solrj_collection_shard2_replica1/'
   [junit4]   2> 892837 T2588 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 892837 T2588 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solrj_collection_shard2_replica2/'
   [junit4]   2> 892934 T2561 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_9
   [junit4]   2> 892934 T2588 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_9
   [junit4]   2> 892978 T2572 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_9
   [junit4]   2> 892993 T2588 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 892997 T2561 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 892998 T2600 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_9
   [junit4]   2> 893002 T2561 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 893002 T2588 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 893025 T2572 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 893030 T2572 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 893031 T2600 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 893033 T2561 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 893034 T2600 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 893041 T2588 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 893101 T2572 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 893111 T2600 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 893850 T2561 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893854 T2561 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893855 T2561 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 893882 T2561 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 893892 T2561 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 893923 T2572 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893924 T2572 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893924 T2600 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893924 T2588 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893926 T2572 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 893925 T2600 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893926 T2588 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 893931 T2600 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 893931 T2588 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 893944 T2572 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 893945 T2588 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 893946 T2600 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 893947 T2572 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 893948 T2588 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 893949 T2600 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 893962 T2561 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 893970 T2561 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 893972 T2588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 893978 T2561 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 893978 T2572 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 893980 T2561 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 893981 T2561 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 893982 T2561 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 893982 T2588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 893984 T2561 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 893984 T2561 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 893985 T2561 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using configuration from collection solrj_collection
   [junit4]   2> 893986 T2572 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 893986 T2561 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 893987 T2561 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solrj_collection_shard1_replica1/, dataDir=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solrj_collection_shard1_replica1/data/
   [junit4]   2> 893988 T2561 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b5a55
   [junit4]   2> 893989 T2588 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 893990 T2588 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 893991 T2588 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 893991 T2588 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 893992 T2561 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solrj_collection_shard1_replica1/data
   [junit4]   2> 893992 T2561 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solrj_collection_shard1_replica1/data/index/
   [junit4]   2> 893993 T2572 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 893993 T2561 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 893993 T2588 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 893995 T2588 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 893994 T2561 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-003/solrj_collection_shard1_replica1/data/index
   [junit4]   2> 893996 T2600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 893997 T2561 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=61.638671875, floorSegmentMB=1.62109375, forceMergeDeletesPctAllowed=22.566498639538842, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 893996 T2572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 893998 T2572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 893996 T2588 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using configuration from collection solrj_collection
   [junit4]   2> 893998 T2561 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@f9e77f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d5fc11),segFN=segments_1,generation=1}
   [junit4]   2> 893999 T2572 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 893999 T2588 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 894000 T2561 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 894001 T2588 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solrj_collection_shard2_replica2/, dataDir=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solrj_collection_shard2_replica2/data/
   [junit4]   2> 894002 T2588 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b5a55
   [junit4]   2> 894003 T2588 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solrj_collection_shard2_replica2/data
   [junit4]   2> 894002 T2572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 894010 T2588 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solrj_collection_shard2_replica2/data/index/
   [junit4]   2> 894003 T2600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 894011 T2588 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 894010 T2572 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 894013 T2588 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-005/solrj_collection_shard2_replica2/data/index
   [junit4]   2> 894013 T2572 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using configuration from collection solrj_collection
   [junit4]   2> 894014 T2588 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=61.638671875, floorSegmentMB=1.62109375, forceMergeDeletesPctAllowed=22.566498639538842, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 894014 T2572 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 894015 T2572 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solrj_collection_shard2_replica1/, dataDir=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solrj_collection_shard2_replica1/data/
   [junit4]   2> 894015 T2588 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1a47893 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1156a2e),segFN=segments_1,generation=1}
   [junit4]   2> 894016 T2588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 894016 T2572 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b5a55
   [junit4]   2> 894018 T2561 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 894018 T2600 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 894018 T2561 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 894020 T2561 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 894020 T2561 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894021 T2600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 894022 T2600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 894021 T2561 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894022 T2572 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solrj_collection_shard2_replica1/data
   [junit4]   2> 894022 T2600 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 894023 T2572 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solrj_collection_shard2_replica1/data/index/
   [junit4]   2> 894023 T2561 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 894025 T2588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 894024 T2572 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory './solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 894026 T2600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 894026 T2572 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-004/solrj_collection_shard2_replica1/data/index
   [junit4]   2> 894026 T2588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 894025 T2561 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 894028 T2588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 894027 T2572 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=61.638671875, floorSegmentMB=1.62109375, forceMergeDeletesPctAllowed=22.566498639538842, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 894026 T2600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 894028 T2588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894028 T2561 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 894030 T2588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894030 T2572 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@4b83fa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@182b784),segFN=segments_1,generation=1}
   [junit4]   2> 894030 T2600 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using configuration from collection solrj_collection
   [junit4]   2> 894032 T2572 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 894031 T2588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 894034 T2588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 894034 T2588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 894031 T2561 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 894035 T2588 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 894032 T2600 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 894037 T2561 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 894037 T2588 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 894037 T2600 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solrj_collection_shard1_replica2/, dataDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solrj_collection_shard1_replica2/data/
   [junit4]   2> 894041 T2561 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 894042 T2561 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 894042 T2600 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b5a55
   [junit4]   2> 894042 T2588 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 894044 T2588 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 894043 T2561 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 894044 T2600 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solrj_collection_shard1_replica2/data
   [junit4]   2> 894044 T2588 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 894045 T2561 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 894045 T2600 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solrj_collection_shard1_replica2/data/index/
   [junit4]   2> 894046 T2561 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 894046 T2588 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 894046 T2572 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 894048 T2561 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 894048 T2588 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 894047 T2600 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 894048 T2572 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 894050 T2600 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/solrj_collection_shard1_replica2/data/index
   [junit4]   2> 894050 T2588 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 894051 T2600 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=61.638671875, floorSegmentMB=1.62109375, forceMergeDeletesPctAllowed=22.566498639538842, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 894051 T2572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 894053 T2572 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894053 T2600 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@9fa842 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1219240),segFN=segments_1,generation=1}
   [junit4]   2> 894053 T2572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894054 T2561 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 894054 T2600 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 894055 T2588 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 894054 T2572 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 894057 T2572 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 894061 T2572 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 894062 T2572 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 894062 T2588 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 894062 T2561 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 894064 T2588 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 894063 T2572 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 894066 T2600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 894064 T2561 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 894067 T2600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 894068 T2600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 894066 T2572 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 894066 T2588 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.509765625, floorSegmentMB=1.958984375, forceMergeDeletesPctAllowed=27.888187361674046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 894069 T2561 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.509765625, floorSegmentMB=1.958984375, forceMergeDeletesPctAllowed=27.888187361674046, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 894068 T2572 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 894068 T2600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894071 T2572 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 894070 T2561 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@f9e77f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d5fc11),segFN=segments_1,generation=1}
   [junit4]   2> 894070 T2588 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1a47893 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1156a2e),segFN=segments_1,generation=1}
   [junit4]   2> 894072 T2588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 894072 T2561 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 894072 T2572 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 894071 T2600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 894075 T2572 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 894074 T2561 oass.SolrIndexSearcher.<init> Opening Searcher@1bbd725[solrj_collection_shard1_replica1] main
   [junit4]   2> 894073 T2588 oass.SolrIndexSearcher.<init> Opening Searcher@1af7581[solrj_collection_shard2_replica2] main
   [junit4]   2> 894076 T2561 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 894075 T2600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 894076 T2588 oascc.ZkStateReader.readConfigName Load co

[...truncated too long message...]

./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/nodes_used_collection_shard1_replica1/data [CachedDir<<refCount=0;path=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/nodes_used_collection_shard1_replica1/data;done=false>>]
   [junit4]   2> 975505 T2607 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/nodes_used_collection_shard1_replica1/data
   [junit4]   2> 975505 T2607 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/nodes_used_collection_shard1_replica1/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/nodes_used_collection_shard1_replica1/data/index;done=false>>]
   [junit4]   2> 975505 T2607 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001/tempDir-006/nodes_used_collection_shard1_replica1/data/index
   [junit4]   2> 975506 T2607 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard1
   [junit4]   2> 975507 T2607 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:290)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 	Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
   [junit4]   2> 		... 7 more
   [junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
   [junit4]   2> 		... 8 more
   [junit4]   2> 	
   [junit4]   2> 975507 T2607 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 975508 T2607 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J1/./solr.cloud.CollectionsAPIDistributedZkTest-3745085B85211730-001
   [junit4]   2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=fi, timezone=America/Monterrey
   [junit4]   2> NOTE: Linux 3.8.0-41-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=1,free=147217792,total=323338240
   [junit4]   2> NOTE: All tests run in this JVM: [BasicDistributedZk2Test, TestCoreDiscovery, DocExpirationUpdateProcessorFactoryTest, SSLMigrationTest, BlockCacheTest, TestFastWriter, UniqFieldsUpdateProcessorFactoryTest, TestComponentsName, TestFiltering, DefaultValueUpdateProcessorTest, SolrTestCaseJ4Test, BadIndexSchemaTest, JSONWriterTest, ZkNodePropsTest, TestUniqueKeyFieldResource, DeleteReplicaTest, TestAnalyzedSuggestions, DirectUpdateHandlerTest, AddBlockUpdateTest, TestNumberUtils, SolrCoreCheckLockOnStartupTest, TestSolrXml, TestReRankQParserPlugin, TestManagedResource, TestArbitraryIndexDir, TestDistributedSearch, DistributedExpandComponentTest, TestSolrDeletionPolicy2, TestQuerySenderListener, TestWordDelimiterFilterFactory, HighlighterConfigTest, HighlighterTest, StandardRequestHandlerTest, TestDynamicFieldCollectionResource, MinimalSchemaTest, TestManagedSchemaFieldResource, DocValuesMissingTest, TestRecovery, TestSolrXmlPersistor, ShardRoutingCustomTest, CurrencyFieldOpenExchangeTest, TestAnalyzeInfixSuggestions, ParsingFieldUpdateProcessorsTest, SolrIndexConfigTest, TestSolrJ, TestCloudManagedSchemaCopyFields, DocumentAnalysisRequestHandlerTest, TestSchemaNameResource, RequiredFieldsTest, ZkSolrClientTest, TestZkChroot, PrimUtilsTest, TestOmitPositions, DisMaxRequestHandlerTest, IndexSchemaRuntimeFieldTest, CursorMarkTest, DistributedSuggestComponentTest, TestJmxIntegration, TestCollationField, TestDocBasedVersionConstraints, DeleteInactiveReplicaTest, SolrRequestParserTest, CoreAdminCreateDiscoverTest, OpenCloseCoreStressTest, SolrPluginUtilsTest, DebugComponentTest, TestExceedMaxTermLength, AlternateDirectoryTest, TestSolrCoreProperties, TestDynamicFieldResource, NoCacheHeaderTest, TestOverriddenPrefixQueryForCustomFieldType, HdfsBasicDistributedZkTest, MultiTermTest, TestCollationKeyRangeQueries, SuggesterWFSTTest, TestCloudManagedSchemaAddField, TestDistributedGrouping, TestCSVResponseWriter, OutputWriterTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed on J1 in 91.15s, 1 test, 1 error <<< FAILURES!

[...truncated 690 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1297: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:921: There were test failures: 405 suites, 1654 tests, 1 error, 38 ignored (17 assumptions)

Total time: 80 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_20-ea-b15 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message