lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-Linux (64bit/jdk1.7.0_60-ea-b14) - Build # 10078 - Failure!
Date Tue, 29 Apr 2014 12:22:46 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/10078/
Java: 64bit/jdk1.7.0_60-ea-b14 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerRolesTest.testDistribSearch

Error Message:
could not set the new overseer . expected 127.0.0.1:48503_ current order : [127.0.0.1:48503_, 127.0.0.1:48503_, 127.0.0.1:42777_, 127.0.0.1:49134_, 127.0.0.1:35421_, 127.0.0.1:37090_, 127.0.0.1:38501_, 127.0.0.1:56578_] ldr :null

Stack Trace:
java.lang.AssertionError: could not set the new overseer . expected 127.0.0.1:48503_ current order : [127.0.0.1:48503_, 127.0.0.1:48503_, 127.0.0.1:42777_, 127.0.0.1:49134_, 127.0.0.1:35421_, 127.0.0.1:37090_, 127.0.0.1:38501_, 127.0.0.1:56578_] ldr :null
	at __randomizedtesting.SeedInfo.seed([8AAF6138669AF533:B49EF2011C5950F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.OverseerRolesTest.testOverseerRole(OverseerRolesTest.java:159)
	at org.apache.solr.cloud.OverseerRolesTest.doTest(OverseerRolesTest.java:95)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
	at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 11810 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/init-core-data-001
   [junit4]   2> 1334247 T5634 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1334250 T5634 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1334250 T5634 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1334250 T5635 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1334350 T5634 oasc.ZkTestServer.run start zk server on port:52714
   [junit4]   2> 1334351 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1357594 T5638 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 23241ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
   [junit4]   2> 1357595 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac20000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1357598 T5641 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b2a09ca name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1357598 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1357598 T5634 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1357601 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1357602 T5643 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3842bc79 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1357602 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1357603 T5634 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1357605 T5634 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1357608 T5634 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1357612 T5634 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1357624 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1357624 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1357628 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1357629 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1357631 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1357632 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1357634 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1357634 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1357636 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1357636 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1357638 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1357639 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1357641 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1357642 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1357645 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1357645 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1357647 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1357647 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1357649 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1357649 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1357651 T5634 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1357651 T5634 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1357882 T5634 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1357884 T5634 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37090
   [junit4]   2> 1357885 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1357885 T5634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1357885 T5634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-002
   [junit4]   2> 1357885 T5634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-002/'
   [junit4]   2> 1357896 T5634 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-002/solr.xml
   [junit4]   2> 1357928 T5634 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-002
   [junit4]   2> 1357928 T5634 oasc.CoreContainer.<init> New CoreContainer 149086420
   [junit4]   2> 1357928 T5634 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-002/]
   [junit4]   2> 1357929 T5634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1357929 T5634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1357929 T5634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1357929 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1357930 T5634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1357930 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1357930 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1357930 T5634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1357931 T5634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1357931 T5634 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1357931 T5634 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1357931 T5634 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1357932 T5634 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52714/solr
   [junit4]   2> 1357932 T5634 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1357932 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1357934 T5654 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@671682da name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1357934 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1357936 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1357937 T5656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21ed1489 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1357937 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1357938 T5634 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1357940 T5634 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1357942 T5634 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1357944 T5634 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1357948 T5634 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1357951 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1357952 T5634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37090_
   [junit4]   2> 1357953 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37090_
   [junit4]   2> 1357955 T5634 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1357956 T5634 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1357959 T5634 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:37090_
   [junit4]   2> 1357959 T5634 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1357961 T5634 oasc.Overseer.start Overseer (id=91670053958844421-127.0.0.1:37090_-n_0000000000) starting
   [junit4]   2> 1357963 T5634 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1357968 T5658 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1357968 T5634 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1357969 T5658 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:37090_
   [junit4]   2> 1357970 T5634 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1357971 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1357972 T5657 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1357974 T5634 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-002
   [junit4]   2> 1357981 T5634 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-002/conf/
   [junit4]   2> 1358066 T5634 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1358067 T5634 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1
   [junit4]   2> 1358067 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1358068 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1358070 T5661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7958b3d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1358070 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1358071 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1358073 T5634 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1358290 T5634 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1358290 T5634 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1358292 T5634 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56578
   [junit4]   2> 1358292 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1358293 T5634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1358293 T5634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-003
   [junit4]   2> 1358293 T5634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-003/'
   [junit4]   2> 1358303 T5634 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-003/solr.xml
   [junit4]   2> 1358325 T5634 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-003
   [junit4]   2> 1358326 T5634 oasc.CoreContainer.<init> New CoreContainer 1166787394
   [junit4]   2> 1358326 T5634 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-003/]
   [junit4]   2> 1358327 T5634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1358327 T5634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1358327 T5634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1358327 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1358328 T5634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1358328 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1358328 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1358328 T5634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1358328 T5634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1358329 T5634 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1358329 T5634 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1358329 T5634 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1358329 T5634 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52714/solr
   [junit4]   2> 1358330 T5634 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1358330 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1358332 T5672 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ac045b9 name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1358332 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1358334 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1358335 T5674 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5fcfca name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1358335 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1358339 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1359341 T5634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56578_
   [junit4]   2> 1359342 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56578_
   [junit4]   2> 1359345 T5656 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1359345 T5674 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1359345 T5661 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1359348 T5634 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-003
   [junit4]   2> 1359354 T5634 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-003/conf/
   [junit4]   2> 1359462 T5634 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1359463 T5634 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1
   [junit4]   2> 1359463 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1359679 T5634 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1359680 T5634 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1359681 T5634 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38501
   [junit4]   2> 1359682 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1359682 T5634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1359682 T5634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-004
   [junit4]   2> 1359683 T5634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-004/'
   [junit4]   2> 1359693 T5634 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-004/solr.xml
   [junit4]   2> 1359714 T5634 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-004
   [junit4]   2> 1359715 T5634 oasc.CoreContainer.<init> New CoreContainer 2078615186
   [junit4]   2> 1359715 T5634 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-004/]
   [junit4]   2> 1359716 T5634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1359716 T5634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1359716 T5634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1359716 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1359716 T5634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1359717 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1359717 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1359717 T5634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1359717 T5634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1359718 T5634 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1359718 T5634 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1359718 T5634 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1359718 T5634 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52714/solr
   [junit4]   2> 1359719 T5634 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1359719 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1359720 T5686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1477aca name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1359721 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1359722 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1359723 T5688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bcd3ee6 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1359723 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1359728 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1360730 T5634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38501_
   [junit4]   2> 1360732 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38501_
   [junit4]   2> 1360734 T5674 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1360734 T5656 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1360734 T5688 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1360734 T5661 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1360738 T5634 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-004
   [junit4]   2> 1360743 T5634 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-004/conf/
   [junit4]   2> 1360863 T5634 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1360864 T5634 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1
   [junit4]   2> 1360864 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1361085 T5634 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1361085 T5634 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1361087 T5634 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48503
   [junit4]   2> 1361088 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1361088 T5634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1361088 T5634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-005
   [junit4]   2> 1361088 T5634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-005/'
   [junit4]   2> 1361099 T5634 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-005/solr.xml
   [junit4]   2> 1361122 T5634 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-005
   [junit4]   2> 1361122 T5634 oasc.CoreContainer.<init> New CoreContainer 2083017038
   [junit4]   2> 1361122 T5634 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-005/]
   [junit4]   2> 1361123 T5634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1361123 T5634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1361123 T5634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1361123 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1361124 T5634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1361124 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1361124 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1361124 T5634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1361125 T5634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1361125 T5634 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1361125 T5634 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1361125 T5634 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1361126 T5634 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52714/solr
   [junit4]   2> 1361126 T5634 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1361127 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361128 T5700 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3af21790 name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361128 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1361130 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1361131 T5702 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1adb926d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1361131 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1361136 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1362138 T5634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48503_
   [junit4]   2> 1362156 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48503_
   [junit4]   2> 1362177 T5674 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1362178 T5702 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1362177 T5688 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1362177 T5656 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1362177 T5661 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1368846 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac20006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1368947 T5661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7958b3d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 1368947 T5661 oascc.ConnectionManager.process zkClient has disconnected
   [junit4]   2> 1370208 T5661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7958b3d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1375514 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac2000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1375515 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac20008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1375517 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac20005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1375519 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac2000c, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1375614 T5688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bcd3ee6 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 1375615 T5688 oascc.ConnectionManager.process zkClient has disconnected
   [junit4]   2> 1375614 T5674 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5fcfca name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 1375615 T5674 oascc.ConnectionManager.process zkClient has disconnected
   [junit4]   2> 1375617 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 1375617 T5656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21ed1489 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 1375617 T5656 oascc.ConnectionManager.process zkClient has disconnected
   [junit4]   2> 1375617 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 1375619 T5702 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1adb926d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 1375619 T5702 oascc.ConnectionManager.process zkClient has disconnected
   [junit4]   2> 1376878 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac20006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1376978 T5661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7958b3d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 1376978 T5661 oascc.ConnectionManager.process zkClient has disconnected
   [junit4]   2> 1377045 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
   [junit4]   2> 1377046 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: SyncConnected type None
   [junit4]   2> 1377046 T5656 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21ed1489 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1377077 T5688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bcd3ee6 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1377301 T5674 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5fcfca name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1377467 T5702 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1adb926d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1378113 T5661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7958b3d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1384783 T5636 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145ad6daac20006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1384883 T5661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7958b3d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 1384883 T5661 oascc.ConnectionManager.process zkClient has disconnected
   [junit4]   2> 1385282 T5638 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 23103ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
   [junit4]   2> 1385283 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
   [junit4]   2> 
   [junit4]   2> 1385283 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385284 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385284 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385284 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385285 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385285 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385285 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385286 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:404)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385286 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:169)
   [junit4]   2> 
   [junit4]   2> 1385290 T5634 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-005
   [junit4]   2> 1385296 T5634 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-005/conf/
   [junit4]   2> 1385407 T5634 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1385408 T5634 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1
   [junit4]   2> 1385408 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1385631 T5634 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 1385632 T5634 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1385634 T5634 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:42777
   [junit4]   2> 1385635 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1385635 T5634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1385636 T5634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-006
   [junit4]   2> 1385636 T5634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-006/'
   [junit4]   2> 1385654 T5634 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-006/solr.xml
   [junit4]   2> 1385677 T5634 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-006
   [junit4]   2> 1385677 T5634 oasc.CoreContainer.<init> New CoreContainer 931371362
   [junit4]   2> 1385677 T5634 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-006/]
   [junit4]   2> 1385678 T5634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1385678 T5634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1385678 T5634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1385679 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1385679 T5634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1385679 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1385679 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1385679 T5634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1385680 T5634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1385680 T5634 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1385680 T5634 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1385680 T5634 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1385681 T5634 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52714/solr
   [junit4]   2> 1385681 T5634 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1385681 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1385684 T5714 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20cb0d67 name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1385684 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1385687 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1385688 T5716 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45a6258d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1385688 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1385692 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1386467 T5661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7958b3d name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1386693 T5634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42777_
   [junit4]   2> 1386694 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42777_
   [junit4]   2> 1386696 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
   [junit4]   2> 	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
   [junit4]   2> 
   [junit4]   2> 1386697 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.createNode(DataTree.java:523)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:791)
   [junit4]   2> 	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
   [junit4]   2> 
   [junit4]   2> 1386698 T5656 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1386698 T5688 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1386698 T5702 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1386698 T5661 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1386698 T5716 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1386698 T5674 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1386702 T5634 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-006
   [junit4]   2> 1386706 T5634 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-006/conf/
   [junit4]   2> 1386792 T5634 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1386793 T5634 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1
   [junit4]   2> 1386793 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1387030 T5634 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
   [junit4]   2> 1387031 T5634 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1387033 T5634 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49134
   [junit4]   2> 1387033 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1387034 T5634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1387034 T5634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-007
   [junit4]   2> 1387034 T5634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-007/'
   [junit4]   2> 1387045 T5634 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-007/solr.xml
   [junit4]   2> 1387067 T5634 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-007
   [junit4]   2> 1387067 T5634 oasc.CoreContainer.<init> New CoreContainer 912890708
   [junit4]   2> 1387067 T5634 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-007/]
   [junit4]   2> 1387068 T5634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1387068 T5634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1387068 T5634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1387069 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1387069 T5634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1387069 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1387069 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1387069 T5634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1387070 T5634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1387070 T5634 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1387070 T5634 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1387071 T5634 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1387071 T5634 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52714/solr
   [junit4]   2> 1387071 T5634 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1387072 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1387074 T5728 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f54c3b4 name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1387074 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1387076 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1387077 T5730 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6eda67ec name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1387078 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1387082 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1388084 T5634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49134_
   [junit4]   2> 1388085 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49134_
   [junit4]   2> 1388087 T5702 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 1388087 T5656 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 1388087 T5661 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 1388087 T5716 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 1388087 T5730 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 1388087 T5674 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 1388087 T5688 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 1388091 T5634 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-007
   [junit4]   2> 1388096 T5634 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-007/conf/
   [junit4]   2> 1388206 T5634 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1388207 T5634 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1
   [junit4]   2> 1388207 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1388444 T5634 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
   [junit4]   2> 1388445 T5634 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1388447 T5634 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:35421
   [junit4]   2> 1388448 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1388448 T5634 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1388448 T5634 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008
   [junit4]   2> 1388449 T5634 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008/'
   [junit4]   2> 1388459 T5634 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008/solr.xml
   [junit4]   2> 1388485 T5634 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008
   [junit4]   2> 1388485 T5634 oasc.CoreContainer.<init> New CoreContainer 1387254112
   [junit4]   2> 1388485 T5634 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008/]
   [junit4]   2> 1388486 T5634 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1388486 T5634 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1388487 T5634 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1388487 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1388487 T5634 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1388487 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1388487 T5634 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1388488 T5634 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1388488 T5634 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1388488 T5634 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1388489 T5634 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1388489 T5634 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1388489 T5634 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52714/solr
   [junit4]   2> 1388490 T5634 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1388491 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1388509 T5742 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14db2009 name:ZooKeeperConnection Watcher:127.0.0.1:52714 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1388509 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1388528 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1388547 T5744 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cf0e293 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1388547 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1388648 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1389651 T5634 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35421_
   [junit4]   2> 1389652 T5634 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:35421_
   [junit4]   2> 1389655 T5656 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389655 T5730 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389655 T5702 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389655 T5716 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389655 T5744 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389655 T5688 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389655 T5674 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389655 T5661 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 1389659 T5634 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008
   [junit4]   2> 1389664 T5634 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008/conf/
   [junit4]   2> 1389771 T5634 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1389772 T5634 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1
   [junit4]   2> 1389772 T5634 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1389773 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1389775 T5747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38018f91 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1389775 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1389776 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1389779 T5634 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1389780 T5749 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b1bd216 name:ZooKeeperConnection Watcher:127.0.0.1:52714/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1389780 T5634 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1389781 T5634 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1389784 T5726 oasha.CollectionsHandler.handleCreateAction Creating Collection : wt=javabin&numShards=4&name=testOverseerQuit&replicationFactor=2&version=2&action=CREATE&maxShardsPerNode=2
   [junit4]   2> 1389785 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1389785 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1389786 T5658 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerQuit",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 1389786 T5658 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerQuit",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 1389787 T5658 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
   [junit4]   2> 1389787 T5658 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerQuit 
   [junit4]   2> 1389787 T5658 oascc.SolrZkClient.makePath makePath: /collections/testOverseerQuit
   [junit4]   2> 1389789 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1389789 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1389790 T5657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1389791 T5657 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerQuit
   [junit4]   2> 1389791 T5657 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerQuit with shards [shard1, shard2, shard3, shard4]
   [junit4]   2> 1389793 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1389794 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
   [junit4]   2> 	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
   [junit4]   2> 
   [junit4]   2> 1389794 T5730 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389794 T5656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389794 T5638 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception:  java.nio.channels.CancelledKeyException
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2> 	at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.process(NIOServerCnxn.java:1118)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:120)
   [junit4]   2> 	at org.apache.zookeeper.server.WatchManager.triggerWatch(WatchManager.java:92)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.setData(DataTree.java:620)
   [junit4]   2> 	at org.apache.zookeeper.server.DataTree.processTxn(DataTree.java:807)
   [junit4]   2> 	at org.apache.zookeeper.server.ZKDatabase.processTxn(ZKDatabase.java:329)
   [junit4]   2> 	at org.apache.zookeeper.server.ZooKeeperServer.processTxn(ZooKeeperServer.java:994)
   [junit4]   2> 	at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:116)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
   [junit4]   2> 	at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
   [junit4]   2> 
   [junit4]   2> 1389795 T5688 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389795 T5744 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389795 T5661 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389795 T5674 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389795 T5716 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389795 T5702 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389795 T5749 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389795 T5747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 1389890 T5658 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2, shard3, shard4] , replicationFactor : 2
   [junit4]   2> 1389890 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica1 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:37090_
   [junit4]   2> 1389891 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard1_replica2 as part of slice shard1 of collection testOverseerQuit on 127.0.0.1:48503_
   [junit4]   2> 1389892 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica1 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:35421_
   [junit4]   2> 1389893 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard2_replica2 as part of slice shard2 of collection testOverseerQuit on 127.0.0.1:49134_
   [junit4]   2> 1389893 T5651 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&wt=javabin&collection.configName=conf1&numShards=4&collection=testOverseerQuit&name=testOverseerQuit_shard1_replica1&version=2&action=CREATE&shard=shard1
   [junit4]   2> 1389894 T5697 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&wt=javabin&collection.configName=conf1&numShards=4&collection=testOverseerQuit&name=testOverseerQuit_shard1_replica2&version=2&action=CREATE&shard=shard1
   [junit4]   2> 1389894 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica1 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:56578_
   [junit4]   2> 1389894 T5739 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&wt=javabin&collection.configName=conf1&numShards=4&collection=testOverseerQuit&name=testOverseerQuit_shard2_replica1&version=2&action=CREATE&shard=shard2
   [junit4]   2> 1389894 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard3_replica2 as part of slice shard3 of collection testOverseerQuit on 127.0.0.1:38501_
   [junit4]   2> 1389895 T5724 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&wt=javabin&collection.configName=conf1&numShards=4&collection=testOverseerQuit&name=testOverseerQuit_shard2_replica2&version=2&action=CREATE&shard=shard2
   [junit4]   2> 1389895 T5651 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica1 state=down collection=testOverseerQuit
   [junit4]   2> 1389895 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica1 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:42777_
   [junit4]   2> 1389895 T5669 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&wt=javabin&collection.configName=conf1&numShards=4&collection=testOverseerQuit&name=testOverseerQuit_shard3_replica1&version=2&action=CREATE&shard=shard3
   [junit4]   2> 1389896 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1389896 T5651 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1389896 T5739 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica1 state=down collection=testOverseerQuit
   [junit4]   2> 1389896 T5684 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&wt=javabin&collection.configName=conf1&numShards=4&collection=testOverseerQuit&name=testOverseerQuit_shard3_replica2&version=2&action=CREATE&shard=shard3
   [junit4]   2> 1389896 T5658 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerQuit_shard4_replica2 as part of slice shard4 of collection testOverseerQuit on 127.0.0.1:37090_
   [junit4]   2> 1389897 T5669 oasc.ZkController.publish publishing core=testOverseerQuit_shard3_replica1 state=down collection=testOverseerQuit
   [junit4]   2> 1389897 T5697 oasc.ZkController.publish publishing core=testOverseerQuit_shard1_replica2 state=down collection=testOverseerQuit
   [junit4]   2> 1389898 T5657 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1389897 T5724 oasc.ZkController.publish publishing core=testOverseerQuit_shard2_replica2 state=down collection=testOverseerQuit
   [junit4]   2> 1389898 T5712 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&wt=javabin&collection.configName=conf1&numShards=4&collection=testOverseerQuit&name=testOverseerQuit_shard4_replica1&version=2&action=CREATE&shard=shard4
   [junit4]   2> 1389898 T5656 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1389898 T5739 oasc.ZkController.waitForCoreNodeN

[...truncated too long message...]

st/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001/tempDir-008/testOverseerQuit_shard2_replica1/data
   [junit4]   2> 1421414 T5744 oascc.SolrZkClient.makePath makePath: /collections/testOverseerQuit/leaders/shard2
   [junit4]   2> 1421414 T5744 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:136)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:291)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 	Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:123)
   [junit4]   2> 		... 7 more
   [junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:209)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:417)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:128)
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
   [junit4]   2> 		... 8 more
   [junit4]   2> 	
   [junit4]   2> 1421415 T5744 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 1421416 T5744 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build/solr-core/test/J1/./solr.cloud.OverseerRolesTest-8AAF6138669AF533-001
   [junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=sk, timezone=Asia/Colombo
   [junit4]   2> NOTE: Linux 3.8.0-38-generic amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=8,threads=1,free=181663296,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestDistribDocBasedVersion, XsltUpdateRequestHandlerTest, AddBlockUpdateTest, HdfsChaosMonkeySafeLeaderTest, RAMDirectoryFactoryTest, TestInfoStreamLogging, RemoteQueryErrorTest, TestAtomicUpdateErrorCases, TestBinaryResponseWriter, TestCoreDiscovery, DirectUpdateHandlerTest, TestFoldingMultitermQuery, AtomicUpdatesTest, DistributedQueryComponentOptimizationTest, AlternateDirectoryTest, SpellingQueryConverterTest, FieldAnalysisRequestHandlerTest, TestSimpleQParserPlugin, TestComponentsName, ChaosMonkeySafeLeaderTest, TestSchemaNameResource, TestPhraseSuggestions, NoCacheHeaderTest, TestRecovery, PreAnalyzedFieldTest, TestCursorMarkWithoutUniqueKey, HdfsBasicDistributedZk2Test, TestOmitPositions, TestBinaryField, TimeZoneUtilsTest, TestFastLRUCache, TestJmxIntegration, SortByFunctionTest, TestReload, HdfsDirectoryTest, TestDefaultSimilarityFactory, DebugComponentTest, TestLazyCores, OpenExchangeRatesOrgProviderTest, TestZkChroot, LeaderElectionIntegrationTest, TestSchemaSimilarityResource, DocValuesMultiTest, ZkNodePropsTest, TestRandomFaceting, ChaosMonkeyNothingIsSafeTest, TestArbitraryIndexDir, TestFieldTypeCollectionResource, TestDFRSimilarityFactory, NotRequiredUniqueKeyTest, TestFuzzyAnalyzedSuggestions, CursorPagingTest, TestNumberUtils, TestConfigSets, TestAnalyzedSuggestions, TestSolr4Spatial, BasicDistributedZk2Test, TestPartialUpdateDeduplication, CoreAdminRequestStatusTest, TestHighlightDedupGrouping, TestManagedStopFilterFactory, JSONWriterTest, TestCloudManagedSchemaAddField, HdfsWriteToMultipleCollectionsTest, TestDistributedMissingSort, TestHashPartitioner, TestDistributedSearch, TermVectorComponentDistributedTest, TestManagedSchema, HdfsSyncSliceTest, CoreContainerCoreInitFailuresTest, CurrencyFieldOpenExchangeTest, TestCodecSupport, ChangedSchemaMergeTest, HdfsUnloadDistributedZkTest, BadCopyFieldTest, BasicZkTest, SolrCmdDistributorTest, DisMaxRequestHandlerTest, TestSolrXmlPersistence, MinimalSchemaTest, TestHighFrequencyDictionaryFactory, PingRequestHandlerTest, SSLMigrationTest, FileUtilsTest, DefaultValueUpdateProcessorTest, TestFastOutputStream, SuggesterTSTTest, TestSolrJ, TestSolrQueryParserResource, HighlighterTest, SpellCheckComponentTest, TestQuerySenderNoQuery, TestIndexSearcher, SyncSliceTest, OpenCloseCoreStressTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, ShardRoutingCustomTest, SliceStateUpdateTest, AutoCommitTest, TestDistributedGrouping, DistributedSpellCheckComponentTest, TestStressReorder, TestJoin, TestMultiCoreConfBootstrap, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, SolrCoreTest, StatsComponentTest, PeerSyncTest, BadIndexSchemaTest, ConvertedLegacyTest, TestFiltering, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SpellCheckCollatorTest, DocValuesTest, TestStressLucene, TestCSVLoader, SolrCoreCheckLockOnStartupTest, TestWordDelimiterFilterFactory, TestRemoteStreaming, IndexBasedSpellCheckerTest, StandardRequestHandlerTest, TestWriterPerf, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, XmlUpdateRequestHandlerTest, TestValueSourceCache, MoreLikeThisHandlerTest, RequiredFieldsTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, IndexSchemaTest, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, CSVRequestHandlerTest, HighlighterConfigTest, TestQuerySenderListener, TestStressRecovery, AssignTest, AsyncMigrateRouteKeyTest, DeleteShardTest, DistribCursorPagingTest, MigrateRouteKeyTest, OverseerRolesTest]
   [junit4] Completed on J1 in 88.01s, 1 test, 1 failure <<< FAILURES!

[...truncated 170 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/lucene/common-build.xml:1297: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux@2/lucene/common-build.xml:921: There were test failures: 389 suites, 1626 tests, 1 failure, 37 ignored (16 assumptions)

Total time: 60 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b14 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message