lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_51) - Build # 3814 - Still Failing!
Date Tue, 25 Mar 2014 14:39:34 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3814/
Java: 32bit/jdk1.7.0_51 -server -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger

Error Message:
Unable to verify all cores have been assigned an id in cloudstate expected:<110> but was:<78>

Stack Trace:
java.lang.AssertionError: Unable to verify all cores have been assigned an id in cloudstate expected:<110> but was:<78>
	at __randomizedtesting.SeedInfo.seed([333D8CBD19CE72FB:A0D372C6F3A78D98]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger(OverseerTest.java:419)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1617)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:826)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:862)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:876)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:783)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:443)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:835)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:771)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:782)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:359)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 19707 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> 2036877 T5740 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 2036878 T5740 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1395756454002
   [junit4]   2> 2036881 T5740 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 2036886 T5740 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
   [junit4]   2> 2036889 T5740 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 2036889 T5741 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2036989 T5740 oasc.ZkTestServer.run start zk server on port:50437
   [junit4]   2> 2036991 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2036999 T5747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e3cbe5 name:ZooKeeperConnection Watcher:127.0.0.1:50437 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037000 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037004 T5742 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144f99150850000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2037006 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037010 T5749 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ccf6e name:ZooKeeperConnection Watcher:127.0.0.1:50437 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037010 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037010 T5740 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2037017 T5742 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144f99150850001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2037020 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037023 T5751 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a9bf6 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037023 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037024 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2037029 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037031 T5753 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@171c9bb name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037032 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037034 T5740 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 2037038 T5740 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2037047 T5740 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50437_solr
   [junit4]   2> 2037047 T5740 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2037051 T5740 oasc.Overseer.start Overseer (id=91472294970720259-127.0.0.1:50437_solr-n_0000000000) starting
   [junit4]   2> 2037055 T5740 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2037061 T5740 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2037068 T5740 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 2037074 T5740 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 2037079 T5740 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 2037087 T5740 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2037099 T5755 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2037100 T5740 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2037101 T5755 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 2037103 T5754 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2037104 T5740 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2037109 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037117 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037120 T5757 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16649ff name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037120 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037122 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037128 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
   [junit4]   2> 2037133 T5751 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 2037134 T5757 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 2037135 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037139 T5759 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c7193a name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037139 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037142 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037146 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 2037151 T5757 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2037151 T5751 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2037152 T5759 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2037154 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037157 T5761 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e0c33c name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037158 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037160 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037164 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 2037170 T5757 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2037170 T5759 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2037171 T5761 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2037172 T5751 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2037172 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037175 T5763 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a9f05b name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037175 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037177 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037183 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
   [junit4]   2> 2037188 T5757 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2037189 T5759 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2037189 T5751 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2037189 T5761 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2037189 T5763 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2037192 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037195 T5765 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a7dde9 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037195 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037199 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037203 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
   [junit4]   2> 2037208 T5751 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2037209 T5763 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2037209 T5757 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2037209 T5759 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2037210 T5761 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2037210 T5765 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2037212 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037215 T5767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ad4e9d name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037215 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037217 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037221 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
   [junit4]   2> 2037229 T5767 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2037229 T5761 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2037229 T5751 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2037230 T5763 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2037230 T5765 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2037230 T5757 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2037230 T5759 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2037232 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037235 T5769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76770 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037236 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037239 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037246 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
   [junit4]   2> 2037251 T5765 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037252 T5751 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037253 T5759 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037257 T5757 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037257 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037257 T5769 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037258 T5767 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037258 T5763 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037258 T5761 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2037262 T5771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@694df9 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037262 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037266 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037273 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
   [junit4]   2> 2037281 T5757 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037282 T5767 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037282 T5765 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037282 T5761 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037284 T5763 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037284 T5769 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037284 T5751 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037284 T5759 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037284 T5771 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2037285 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037290 T5773 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@798f14 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037290 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037293 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037299 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
   [junit4]   2> 2037304 T5763 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037306 T5769 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037306 T5751 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037306 T5757 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037307 T5761 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037307 T5767 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037307 T5771 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037307 T5765 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037307 T5759 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037307 T5773 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2037310 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037314 T5775 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a58f25 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037314 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037316 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037320 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
   [junit4]   2> 2037326 T5761 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037328 T5767 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037328 T5771 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037328 T5757 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037330 T5769 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037330 T5751 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037330 T5759 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037330 T5765 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037330 T5763 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037331 T5773 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037331 T5775 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2037332 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037336 T5777 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fa2dae name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037336 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037338 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037343 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
   [junit4]   2> 2037348 T5767 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037349 T5771 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037351 T5761 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037352 T5769 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037352 T5751 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037352 T5775 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037352 T5763 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037352 T5757 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037352 T5773 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037353 T5765 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037353 T5759 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037353 T5777 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2037354 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037359 T5779 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23181 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037359 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037362 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037367 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
   [junit4]   2> 2037376 T5775 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037378 T5763 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037379 T5777 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037380 T5765 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037380 T5767 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037382 T5773 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037383 T5751 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037384 T5771 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037384 T5761 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037386 T5759 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037387 T5779 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037388 T5757 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037388 T5769 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2037391 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037394 T5781 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11cf583 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037394 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037396 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037402 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
   [junit4]   2> 2037408 T5763 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037408 T5777 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037410 T5781 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037410 T5775 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037410 T5773 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037411 T5769 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037411 T5761 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037411 T5767 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037411 T5757 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037411 T5771 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037412 T5765 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037412 T5759 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037412 T5751 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037412 T5779 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2037416 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037419 T5783 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17541b8 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037419 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037421 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037426 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
   [junit4]   2> 2037432 T5761 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037433 T5757 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037435 T5777 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037436 T5765 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037436 T5781 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037436 T5751 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037436 T5779 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037436 T5759 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037436 T5773 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037437 T5769 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037437 T5771 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037437 T5767 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037437 T5775 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037437 T5763 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037438 T5783 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2037438 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037444 T5785 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13c4ca8 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037444 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037447 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037453 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
   [junit4]   2> 2037463 T5775 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037463 T5763 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037464 T5781 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037464 T5785 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037464 T5771 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037464 T5767 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037465 T5761 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037465 T5757 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037465 T5765 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037465 T5779 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037466 T5751 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037466 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037466 T5783 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037467 T5777 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037466 T5769 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037466 T5759 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037466 T5773 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2037472 T5787 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ddba94 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037472 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037475 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037480 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
   [junit4]   2> 2037490 T5773 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037491 T5759 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037491 T5751 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037492 T5779 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037492 T5765 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037492 T5775 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037493 T5769 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037493 T5787 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037494 T5763 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037495 T5761 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037495 T5771 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037495 T5767 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037495 T5757 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037496 T5783 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037497 T5785 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037497 T5777 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037497 T5781 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2037498 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037502 T5789 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f8eec name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037502 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037505 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037508 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
   [junit4]   2> 2037514 T5787 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037516 T5781 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037518 T5789 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037519 T5759 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037519 T5773 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037520 T5783 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037520 T5763 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037520 T5775 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037520 T5757 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037520 T5767 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037520 T5761 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037521 T5771 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037521 T5769 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037521 T5765 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037521 T5779 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037521 T5785 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037522 T5777 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037522 T5751 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2037522 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037525 T5791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9e4d80 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037525 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037527 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037532 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
   [junit4]   2> 2037536 T5789 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037536 T5783 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037540 T5791 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037540 T5769 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037540 T5779 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037541 T5773 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037541 T5751 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037541 T5759 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037541 T5765 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037542 T5781 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5785 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5777 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5775 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5787 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5763 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5771 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5767 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5761 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037542 T5757 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2037546 T5793 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35caec name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037546 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037548 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037552 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
   [junit4]   2> 2037559 T5785 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037560 T5791 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037560 T5783 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037560 T5789 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037561 T5759 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037563 T5787 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037563 T5761 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037563 T5757 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037563 T5769 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037564 T5793 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037565 T5767 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037565 T5771 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037565 T5781 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037565 T5777 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037565 T5775 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037566 T5763 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037566 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037566 T5779 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037566 T5765 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037566 T5773 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037566 T5751 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2037570 T5795 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1616a53 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037570 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037572 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037577 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
   [junit4]   2> 2037585 T5765 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037585 T5793 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037585 T5779 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037586 T5751 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037586 T5773 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037588 T5759 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037589 T5769 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037590 T5795 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037590 T5767 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037590 T5791 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037590 T5787 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5757 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5763 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037591 T5785 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5781 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5783 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5789 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5777 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5761 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5771 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037591 T5775 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2037594 T5797 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e2445f name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037594 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037596 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037600 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
   [junit4]   2> 2037606 T5781 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037607 T5787 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037608 T5769 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037608 T5785 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037608 T5767 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037608 T5789 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037608 T5765 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037609 T5783 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037609 T5779 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037610 T5795 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037610 T5761 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037610 T5793 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037610 T5771 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037611 T5773 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037611 T5763 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037611 T5791 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037611 T5759 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037611 T5777 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037611 T5775 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037612 T5751 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037612 T5757 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037612 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037612 T5797 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2037614 T5799 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17f1511 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037615 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037617 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037621 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
   [junit4]   2> 2037625 T5781 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037628 T5787 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037630 T5757 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037630 T5767 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037630 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037630 T5761 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037633 T5797 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037633 T5769 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037633 T5795 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037633 T5793 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037633 T5765 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5789 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5775 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037630 T5771 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5763 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5783 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5791 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5759 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5785 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5777 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5773 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5751 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037634 T5799 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037636 T5801 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc8bf9 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037634 T5779 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2037637 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037639 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037642 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
   [junit4]   2> 2037649 T5769 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037652 T5795 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037652 T5781 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037653 T5779 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037653 T5751 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037653 T5791 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037653 T5787 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037653 T5775 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037654 T5789 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037654 T5759 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037654 T5763 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037654 T5797 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037654 T5771 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037654 T5777 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5757 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5773 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037655 T5801 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5767 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5765 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5761 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5799 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5793 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5783 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037655 T5785 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2037658 T5803 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33cc6e name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037658 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037662 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037666 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
   [junit4]   2> 2037677 T5761 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037677 T5797 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037678 T5771 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037679 T5751 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037680 T5795 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037681 T5785 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037682 T5765 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037683 T5769 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037683 T5773 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037684 T5777 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037685 T5767 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037685 T5783 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037686 T5759 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037687 T5793 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037687 T5803 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037687 T5757 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037688 T5801 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037688 T5779 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037690 T5789 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037693 T5791 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037693 T5781 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037693 T5775 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037693 T5799 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037693 T5787 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037693 T5763 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2037693 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037698 T5805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58ae16 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037699 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037704 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037708 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
   [junit4]   2> 2037721 T5785 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037721 T5789 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037722 T5805 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037722 T5803 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037722 T5757 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037722 T5793 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037723 T5795 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037723 T5751 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037723 T5775 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037723 T5763 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037723 T5799 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037723 T5771 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037724 T5781 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037724 T5783 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037724 T5767 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037724 T5791 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037724 T5773 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037725 T5787 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037725 T5769 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037725 T5779 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037725 T5765 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037725 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037726 T5761 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037726 T5777 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037726 T5797 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037726 T5801 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037725 T5759 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2037728 T5807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18bbb1f name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037729 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037730 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037736 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
   [junit4]   2> 2037752 T5769 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037752 T5779 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037752 T5807 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037752 T5765 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037753 T5775 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037753 T5801 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037753 T5773 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037753 T5759 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037753 T5797 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037754 T5805 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037754 T5785 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037754 T5793 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037754 T5757 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037754 T5767 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037755 T5771 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037755 T5789 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037755 T5803 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037755 T5761 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037755 T5781 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037755 T5799 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037756 T5763 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037756 T5795 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037756 T5751 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037757 T5787 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037757 T5777 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037757 T5791 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037757 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037757 T5783 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2037760 T5809 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e892ba name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037762 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037763 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037767 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
   [junit4]   2> 2037779 T5785 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037780 T5789 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037780 T5805 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037780 T5799 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037780 T5807 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037781 T5757 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037781 T5803 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037781 T5809 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037781 T5761 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037781 T5769 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037782 T5779 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037782 T5765 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037782 T5777 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037782 T5791 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037782 T5783 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037783 T5775 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037783 T5763 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037783 T5781 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037783 T5787 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037783 T5797 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037784 T5767 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037784 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037784 T5795 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037785 T5759 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037784 T5801 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037785 T5793 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037784 T5771 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037785 T5751 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037785 T5773 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2037788 T5811 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b29ff name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037788 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037791 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037794 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
   [junit4]   2> 2037801 T5797 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037801 T5767 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037801 T5771 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037802 T5761 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037803 T5785 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037803 T5759 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037805 T5795 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037805 T5805 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037805 T5789 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037805 T5781 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037805 T5811 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037806 T5783 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037806 T5787 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037806 T5769 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037806 T5775 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5773 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5763 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5765 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037807 T5757 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5799 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5803 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5801 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5779 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5791 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5751 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5809 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5777 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5807 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037807 T5793 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2037810 T5813 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cbb9c6 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037811 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037812 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037816 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
   [junit4]   2> 2037822 T5783 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037823 T5791 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037823 T5811 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037823 T5787 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037823 T5777 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037825 T5813 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037825 T5781 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037825 T5785 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037826 T5795 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037826 T5803 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037826 T5765 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037826 T5767 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037827 T5801 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037827 T5793 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037827 T5805 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037828 T5789 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037828 T5751 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037828 T5763 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037828 T5799 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037829 T5779 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037829 T5773 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037830 T5759 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037830 T5807 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037830 T5809 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037830 T5761 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037830 T5757 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037831 T5771 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037832 T5769 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037832 T5775 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037832 T5797 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2037834 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037838 T5815 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b4b79 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037838 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037840 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037843 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
   [junit4]   2> 2037849 T5769 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037849 T5765 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037850 T5779 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037851 T5803 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037851 T5761 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037852 T5793 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037853 T5773 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037853 T5777 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037853 T5783 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037854 T5785 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037854 T5781 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037854 T5809 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037854 T5775 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037854 T5791 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037855 T5799 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037855 T5805 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037855 T5787 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037855 T5771 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037855 T5797 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037855 T5751 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5815 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037856 T5795 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5811 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037857 T5763 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037857 T5807 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5789 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5757 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5813 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5767 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5801 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037856 T5759 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2037859 T5817 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10542e9 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037860 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037861 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037865 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
   [junit4]   2> 2037871 T5807 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037874 T5799 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037875 T5817 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037875 T5775 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037875 T5803 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037875 T5781 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037875 T5813 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037876 T5789 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037876 T5779 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037876 T5785 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037876 T5751 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037876 T5763 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037878 T5757 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037878 T5795 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037878 T5761 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037878 T5787 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037878 T5811 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037878 T5773 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037880 T5765 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037880 T5791 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037879 T5809 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037879 T5769 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037879 T5759 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037879 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037879 T5801 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037879 T5805 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037879 T5771 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037880 T5797 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037883 T5819 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@acbd4d name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037880 T5767 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037880 T5777 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037880 T5793 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037880 T5815 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037880 T5783 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2037883 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037886 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037889 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
   [junit4]   2> 2037903 T5791 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037903 T5777 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037904 T5783 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037904 T5809 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037904 T5813 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037904 T5775 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037905 T5763 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037905 T5781 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037905 T5787 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5815 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037907 T5817 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037908 T5799 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037908 T5789 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037908 T5805 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5759 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037909 T5803 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5811 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5751 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037909 T5769 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037910 T5807 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5785 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037910 T5819 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037910 T5779 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5793 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037911 T5765 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037911 T5761 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5773 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037913 T5757 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5795 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5801 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5771 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5767 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037907 T5797 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2037916 T5821 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16911fb name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037917 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037919 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037924 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
   [junit4]   2> 2037931 T5779 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037931 T5765 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037937 T5769 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037937 T5781 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037937 T5795 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037938 T5751 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037938 T5759 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037938 T5799 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037939 T5801 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037939 T5771 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037939 T5797 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037939 T5789 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037940 T5815 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037940 T5773 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037940 T5783 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037940 T5807 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037941 T5757 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037941 T5793 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037941 T5811 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037941 T5821 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037942 T5791 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037942 T5809 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5775 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5740 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2037943 T5803 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037944 T5761 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037944 T5813 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5817 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5787 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5763 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5819 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5767 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5785 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5777 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037943 T5805 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2037947 T5823 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9c0fe1 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2037948 T5740 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2037951 T5740 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2037956 T5740 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
   [junit4]   2> 2037971 T5807 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037972 T5805 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037974 T5799 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037976 T5821 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037977 T5785 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037977 T5765 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037977 T5789 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037977 T5817 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037979 T5779 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037979 T5811 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037979 T5795 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037979 T5769 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037979 T5793 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037980 T5761 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037980 T5813 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037980 T5773 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037980 T5819 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037980 T5797 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037980 T5791 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037981 T5815 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037981 T5751 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037981 T5781 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037981 T5775 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037982 T5767 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037982 T5809 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2037982 T5740 oascc.ConnectionManager.waitFo

[...truncated too long message...]

tions/collection1/leader_elect/shard1/election
   [junit4]   2> 2148578 T6152 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 2148578 T6152 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 2148583 T6151 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2148592 T5740 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 2148602 T6151 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2148610 T6151 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2148711 T6155 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2148711 T6143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2148713 T5740 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2148718 T6155 oascc.ZkStateReader$3.process Updating live nodes... (0)
   [junit4]   2> 2148719 T6143 oascc.ZkStateReader$3.process Updating live nodes... (0)
   [junit4]   2> 2148724 T5740 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:50839 50839
   [junit4]   2> 2150186 T6152 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue-work/qn-0000000002
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:276)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:273)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:273)
   [junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:178)
   [junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.poll(DistributedQueue.java:493)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:265)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 2150933 T5740 oas.SolrTestCaseJ4.tearDown ###Ending testDoubleAssignment
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2150934 T5740 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 2150934 T5740 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 2153875 T5740 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=ja_JP_JP_#u-ca-japanese, timezone=Kwajalein
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_51 (32-bit)/cpus=2,threads=1,free=35555848,total=159383552
   [junit4]   2> NOTE: All tests run in this JVM: [TestValueSourceCache, DisMaxRequestHandlerTest, TestCloudManagedSchema, QueryParsingTest, TestCopyFieldCollectionResource, CacheHeaderTest, LukeRequestHandlerTest, DocumentAnalysisRequestHandlerTest, SolrIndexConfigTest, TestBM25SimilarityFactory, TestFaceting, HdfsLockFactoryTest, TestArbitraryIndexDir, BlockCacheTest, ReturnFieldsTest, DocValuesMissingTest, TestZkChroot, TestNumberUtils, TestExtendedDismaxParser, NotRequiredUniqueKeyTest, TestStressReorder, DirectUpdateHandlerTest, TestCharFilters, TestReversedWildcardFilterFactory, TestSolrCoreProperties, TestSimpleQParserPlugin, TestSchemaVersionResource, TestHashPartitioner, TestReload, PrimUtilsTest, TestRangeQuery, TestFileDictionaryLookup, TestCSVLoader, QueryElevationComponentTest, TestInitQParser, WordBreakSolrSpellCheckerTest, IndexBasedSpellCheckerTest, CachingDirectoryFactoryTest, FastVectorHighlighterTest, SimplePostToolTest, DebugComponentTest, DeleteInactiveReplicaTest, TestAnalyzeInfixSuggestions, DocumentBuilderTest, TermsComponentTest, HighlighterTest, TestRandomFaceting, AlternateDirectoryTest, UUIDFieldTest, TestIndexingPerformance, BasicFunctionalityTest, StressHdfsTest, RequestHandlersTest, IndexSchemaTest, SolrIndexSplitterTest, CurrencyFieldXmlFileTest, TestSerializedLuceneMatchVersion, TestStandardQParsers, DistributedQueryElevationComponentTest, FullSolrCloudDistribCmdsTest, TestSolrQueryParserResource, SchemaVersionSpecificBehaviorTest, CursorMarkTest, BadIndexSchemaTest, InfoHandlerTest, CoreAdminCreateDiscoverTest, RegexBoostProcessorTest, SolrCoreTest, LegacyHTMLStripCharFilterTest, FieldMutatingUpdateProcessorTest, TestSolrDeletionPolicy2, TestShardHandlerFactory, NoCacheHeaderTest, SolrPluginUtilsTest, PingRequestHandlerTest, TermVectorComponentTest, CollectionsAPIDistributedZkTest, ZkControllerTest, TestSurroundQueryParser, IndexSchemaRuntimeFieldTest, TimeZoneUtilsTest, ResponseLogComponentTest, TermVectorComponentDistributedTest, TestQueryUtils, BJQParserTest, HdfsSyncSliceTest, DOMUtilTest, TestDefaultSimilarityFactory, HdfsBasicDistributedZk2Test, TestPseudoReturnFields, SpellCheckComponentTest, TestFiltering, SuggesterWFSTTest, SimpleFacetsTest, SystemInfoHandlerTest, TestSolrJ, ChaosMonkeyNothingIsSafeTest, AsyncMigrateRouteKeyTest, DeleteShardTest, TestDistribDocBasedVersion, OpenExchangeRatesOrgProviderTest, BlockDirectoryTest, TestSort, TestRecovery, SynonymTokenizerTest, TestMultiCoreConfBootstrap, HdfsRecoveryZkTest, AnalysisAfterCoreReloadTest, SuggestComponentTest, SSLMigrationTest, OpenCloseCoreStressTest, TestRecoveryHdfs, TestAtomicUpdateErrorCases, TestCSVResponseWriter, DeleteReplicaTest, SpatialFilterTest, TestOverriddenPrefixQueryForCustomFieldType, ClusterStateTest, TestCollationKeyRangeQueries, TestRemoteStreaming, TestCoreDiscovery, AddSchemaFieldsUpdateProcessorFactoryTest, TestDFRSimilarityFactory, ZkNodePropsTest, TestCloudManagedSchemaAddField, TestOmitPositions, DirectSolrSpellCheckerTest, TestDistributedSearch, FileBasedSpellCheckerTest, DefaultValueUpdateProcessorTest, TestInfoStreamLogging, TestUtils, DocValuesTest, TestLMDirichletSimilarityFactory, DistributedExpandComponentTest, RAMDirectoryFactoryTest, BadComponentTest, TestDynamicFieldCollectionResource, TestSolrXmlPersistence, RecoveryZkTest, TestSolrQueryParserDefaultOperatorResource, TestSolrDeletionPolicy1, SortByFunctionTest, SuggesterTSTTest, TestFastWriter, TestManagedSchema, TestExpandComponent, TestPHPSerializedResponseWriter, TestQuerySenderNoQuery, OverseerCollectionProcessorTest, TestDistributedGrouping, TestSolr4Spatial, TestStressLucene, FieldAnalysisRequestHandlerTest, EchoParamsTest, TestGroupingSearch, NumericFieldsTest, TestConfigSets, QueryEqualityTest, CopyFieldTest, CSVRequestHandlerTest, TestRequestStatusCollectionAPI, TestLFUCache, TestSchemaNameResource, TestHighlightDedupGrouping, TestNonDefinedSimilarityFactory, TestDocBasedVersionConstraints, TestLMJelinekMercerSimilarityFactory, TestLuceneMatchVersion, TestUpdate, DirectSolrConnectionTest, TestStressRecovery, TestWriterPerf, AnalysisErrorHandlingTest, TestLRUCache, MultiTermTest, ChangedSchemaMergeTest, StandardRequestHandlerTest, TestCursorMarkWithoutUniqueKey, TestCollapseQParserPlugin, DistributedQueryComponentCustomSortTest, EnumFieldTest, SliceStateTest, TestSearcherReuse, URLClassifyProcessorTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, SyncSliceTest, OverseerTest]
   [junit4] Completed in 117.06s, 9 tests, 1 failure <<< FAILURES!

[...truncated 577 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1276: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:908: There were test failures: 379 suites, 1602 tests, 1 failure, 42 ignored (21 assumptions)

Total time: 96 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message