lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_65) - Build # 10850 - Failure!
Date Sat, 19 Jul 2014 15:15:28 GMT
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10850/
Java: 64bit/jdk1.7.0_65 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1

Stack Trace:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1
	at __randomizedtesting.SeedInfo.seed([738AC018F79C1A3A:77824FEBE539F51B]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:329)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:142)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11551 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.OverseerTest-738AC018F79C1A3A-001/init-core-data-001
   [junit4]   2> 1626062 T4101 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1626062 T4101 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 1626062 T4101 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 1626065 T4101 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
   [junit4]   2> 1626066 T4101 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1626066 T4102 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1626166 T4101 oasc.ZkTestServer.run start zk server on port:55185
   [junit4]   2> 1626167 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626169 T4108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b0cde45 name:ZooKeeperConnection Watcher:127.0.0.1:55185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626169 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626171 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626172 T4110 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19304aaa name:ZooKeeperConnection Watcher:127.0.0.1:55185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626172 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626172 T4101 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1626174 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626175 T4112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39f5fb99 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626175 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626176 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1626177 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626177 T4114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a1c060a name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626178 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626178 T4101 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1626179 T4101 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1626181 T4101 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55185_solr
   [junit4]   2> 1626181 T4101 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1626182 T4101 oasc.Overseer.start Overseer (id=92129314140061699-127.0.0.1:55185_solr-n_0000000000) starting
   [junit4]   2> 1626183 T4101 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1626184 T4101 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1626186 T4101 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1626187 T4101 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1626188 T4101 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1626190 T4101 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1626192 T4116 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1626193 T4101 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1626193 T4115 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1626194 T4101 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1626195 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626196 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626197 T4118 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58f4c77e name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626198 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626198 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626199 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
   [junit4]   2> 1626201 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626202 T4120 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bc424d0 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626202 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626203 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626204 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 1626206 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626207 T4122 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dc90316 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626207 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626208 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626209 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 1626211 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626211 T4124 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bd5dad5 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626212 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626212 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626213 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
   [junit4]   2> 1626215 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626216 T4126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad8fd1e name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626216 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626217 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626218 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
   [junit4]   2> 1626220 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626221 T4128 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19601d3f name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626221 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626222 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626223 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
   [junit4]   2> 1626230 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626231 T4130 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61b0ea07 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626231 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626231 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626232 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
   [junit4]   2> 1626235 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626236 T4132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18ed0454 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626236 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626236 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626237 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
   [junit4]   2> 1626240 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626241 T4134 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b26ad57 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626242 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626242 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626243 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
   [junit4]   2> 1626246 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626247 T4136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4118f3cc name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626247 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626248 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626249 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
   [junit4]   2> 1626251 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626252 T4138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19fdab05 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626252 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626253 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626254 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
   [junit4]   2> 1626257 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626258 T4140 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e956fc8 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626258 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626258 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626259 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
   [junit4]   2> 1626262 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626263 T4142 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@470e77a name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626263 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626264 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626265 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
   [junit4]   2> 1626268 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626269 T4144 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d07e515 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626269 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626270 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626271 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
   [junit4]   2> 1626274 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626275 T4146 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f1fc824 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626275 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626276 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626277 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
   [junit4]   2> 1626280 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626281 T4148 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7864ef07 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626281 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626282 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626283 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
   [junit4]   2> 1626286 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626287 T4150 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f97568e name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626287 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626287 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626288 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
   [junit4]   2> 1626291 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626292 T4152 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@366a2fbc name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626292 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626293 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626294 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
   [junit4]   2> 1626297 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626298 T4154 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15f0d361 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626298 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626299 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626300 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
   [junit4]   2> 1626304 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626305 T4156 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@141369b4 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626305 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626306 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626307 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
   [junit4]   2> 1626310 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626311 T4158 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@571f22fc name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626311 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626312 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626313 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
   [junit4]   2> 1626316 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626317 T4160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20a82ea name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626317 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626318 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626319 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
   [junit4]   2> 1626323 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626324 T4162 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@106540cd name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626324 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626324 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626325 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
   [junit4]   2> 1626329 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626330 T4164 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b8177b2 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626331 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626331 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626332 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
   [junit4]   2> 1626336 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626337 T4166 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e718e33 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626337 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626338 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626339 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
   [junit4]   2> 1626342 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626343 T4168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e98e87 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626343 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626344 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626345 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
   [junit4]   2> 1626349 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626350 T4170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@608d6919 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626350 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626351 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626352 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
   [junit4]   2> 1626356 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626362 T4172 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@408a6c7c name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626362 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626364 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626366 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
   [junit4]   2> 1626370 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626370 T4174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f919a1 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626370 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626371 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626372 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
   [junit4]   2> 1626376 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626377 T4176 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61dd0c25 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626377 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626378 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626379 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
   [junit4]   2> 1626383 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626384 T4178 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@202b1347 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626384 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626384 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626386 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
   [junit4]   2> 1626390 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626391 T4180 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7875c549 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626391 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626391 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626392 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
   [junit4]   2> 1626396 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626397 T4182 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e88d4b7 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626397 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626398 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626399 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
   [junit4]   2> 1626404 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626404 T4184 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33d7e6ee name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626404 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626405 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626406 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
   [junit4]   2> 1626411 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626411 T4186 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73a43aa0 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626412 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626412 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626413 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node34
   [junit4]   2> 1626417 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626418 T4188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26b1788 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626418 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626419 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626420 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node35
   [junit4]   2> 1626424 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626424 T4190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142c250c name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626425 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626425 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626426 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node36
   [junit4]   2> 1626431 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626432 T4192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32f994f1 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626432 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626432 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626434 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node37
   [junit4]   2> 1626438 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626439 T4194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75e211c6 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626439 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626440 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626441 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node38
   [junit4]   2> 1626446 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626447 T4196 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@530177c1 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626447 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626448 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626449 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node39
   [junit4]   2> 1626454 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626455 T4198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@364e9a5 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626455 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626456 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626457 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node40
   [junit4]   2> 1626462 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626463 T4200 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@191feccd name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626463 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626464 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626465 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node41
   [junit4]   2> 1626471 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626472 T4202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fcef9ce name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626472 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626472 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626473 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node42
   [junit4]   2> 1626479 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626480 T4204 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dee6de1 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626480 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626480 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626481 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node43
   [junit4]   2> 1626486 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626487 T4206 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d2ab09d name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626487 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626488 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626489 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node44
   [junit4]   2> 1626494 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626495 T4208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14b48562 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626495 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626496 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626497 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node45
   [junit4]   2> 1626503 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626504 T4210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3abe24f5 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626504 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626504 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626506 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node46
   [junit4]   2> 1626511 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626512 T4212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f6c9253 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626512 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626513 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626514 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node47
   [junit4]   2> 1626519 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626520 T4214 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@403564ca name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626520 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626521 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626522 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node48
   [junit4]   2> 1626527 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626528 T4216 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f878e3e name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626528 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626529 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626530 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node49
   [junit4]   2> 1626536 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626537 T4218 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64a2604c name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626537 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626538 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626539 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node50
   [junit4]   2> 1626544 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626545 T4220 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22b639de name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626546 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626546 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626547 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node51
   [junit4]   2> 1626552 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626553 T4222 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52f20eaa name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626553 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626554 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626555 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node52
   [junit4]   2> 1626560 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626562 T4224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64d8f309 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626562 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626563 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626564 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node53
   [junit4]   2> 1626569 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626570 T4226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73907fe4 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626570 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626571 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626572 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node54
   [junit4]   2> 1626577 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626579 T4228 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37a506f0 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626579 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626580 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626581 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node55
   [junit4]   2> 1626587 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626588 T4230 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24119ddb name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626588 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626589 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626590 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node56
   [junit4]   2> 1626597 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626598 T4232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69d6de7c name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626599 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626599 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626600 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node57
   [junit4]   2> 1626608 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626609 T4234 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6eeca9e6 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626609 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626609 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626610 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node58
   [junit4]   2> 1626617 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626618 T4236 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bb39e84 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626618 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626619 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626620 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node59
   [junit4]   2> 1626627 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626628 T4238 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cdef807 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626628 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626628 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626630 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node60
   [junit4]   2> 1626637 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626638 T4240 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34310cc5 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626638 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626638 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626640 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node61
   [junit4]   2> 1626648 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626649 T4242 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ea68a81 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626649 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626649 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626650 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node62
   [junit4]   2> 1626657 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626658 T4244 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dc6f139 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626659 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626659 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626660 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node63
   [junit4]   2> 1626667 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626668 T4246 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1535c82d name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626668 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626669 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626670 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node64
   [junit4]   2> 1626677 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626678 T4248 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fc9e7e0 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626678 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626679 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626680 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node65
   [junit4]   2> 1626687 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626688 T4250 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@338ae0a9 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626688 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626689 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626690 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node66
   [junit4]   2> 1626697 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626697 T4252 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b23ffa9 name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626698 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626698 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626699 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node67
   [junit4]   2> 1626706 T4101 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1626707 T4254 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b832ffa name:ZooKeeperConnection Watcher:127.0.0.1:55185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1626707 T4101 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1626708 T4101 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1626709 T4101 oascc.SolrZkClient.makePath makePath: /live_nodes/node68
   [junit4]   2> 1626719 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626720 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626721 T4115 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1626722 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node0",
   [junit4]   2> 	  "core":"core0",
   [junit4]   2> 	  "core_node_name":"node0",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node0/solr/"}
   [junit4]   2> 1626722 T4115 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9]
   [junit4]   2> 1626722 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1626743 T4120 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4144 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4146 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4210 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4122 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4230 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4166 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4208 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4174 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4140 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4214 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4232 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4190 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4198 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4178 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4172 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626747 T4150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4176 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4186 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4168 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4184 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626747 T4156 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4222 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4196 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626749 T4218 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4138 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4158 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4152 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4130 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4240 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626746 T4212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4194 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4118 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4142 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4128 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4250 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626745 T4238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4162 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4206 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4112 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626753 T4248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4234 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4134 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4180 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4200 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4254 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626744 T4216 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4136 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4182 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626743 T4204 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 69)
   [junit4]   2> 1626762 T4115 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1626763 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 1626763 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626763 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard7
   [junit4]   2> 1626765 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626765 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core2",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 1626766 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626766 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1626768 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626769 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node5",
   [junit4]   2> 	  "core":"core5",
   [junit4]   2> 	  "core_node_name":"node5",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node5/solr/"}
   [junit4]   2> 1626769 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626769 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard8
   [junit4]   2> 1626771 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626771 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node4",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node4",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node4/solr/"}
   [junit4]   2> 1626771 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626772 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
   [junit4]   2> 1626773 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626774 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node7",
   [junit4]   2> 	  "core":"core7",
   [junit4]   2> 	  "core_node_name":"node7",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node7/solr/"}
   [junit4]   2> 1626774 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626774 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1626776 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626777 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node3",
   [junit4]   2> 	  "core":"core3",
   [junit4]   2> 	  "core_node_name":"node3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node3/solr/"}
   [junit4]   2> 1626777 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626777 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard6
   [junit4]   2> 1626779 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626779 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node6",
   [junit4]   2> 	  "core":"core6",
   [junit4]   2> 	  "core_node_name":"node6",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node6/solr/"}
   [junit4]   2> 1626780 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626780 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard9
   [junit4]   2> 1626781 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626782 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node8",
   [junit4]   2> 	  "core":"core8",
   [junit4]   2> 	  "core_node_name":"node8",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node8/solr/"}
   [junit4]   2> 1626782 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626782 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard5
   [junit4]   2> 1626783 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626784 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node11",
   [junit4]   2> 	  "core":"core11",
   [junit4]   2> 	  "core_node_name":"node11",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node11/solr/"}
   [junit4]   2> 1626784 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626784 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1626785 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626786 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node9",
   [junit4]   2> 	  "core":"core9",
   [junit4]   2> 	  "core_node_name":"node9",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node9/solr/"}
   [junit4]   2> 1626786 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626786 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard7
   [junit4]   2> 1626789 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626790 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node10",
   [junit4]   2> 	  "core":"core10",
   [junit4]   2> 	  "core_node_name":"node10",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node10/solr/"}
   [junit4]   2> 1626790 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626790 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1626792 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626792 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node16",
   [junit4]   2> 	  "core":"core16",
   [junit4]   2> 	  "core_node_name":"node16",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node16/solr/"}
   [junit4]   2> 1626793 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626793 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard8
   [junit4]   2> 1626794 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626795 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node17",
   [junit4]   2> 	  "core":"core17",
   [junit4]   2> 	  "core_node_name":"node17",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node17/solr/"}
   [junit4]   2> 1626795 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626795 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard4
   [junit4]   2> 1626796 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626797 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node18",
   [junit4]   2> 	  "core":"core18",
   [junit4]   2> 	  "core_node_name":"node18",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node18/solr/"}
   [junit4]   2> 1626797 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626797 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1626798 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626799 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node14",
   [junit4]   2> 	  "core":"core14",
   [junit4]   2> 	  "core_node_name":"node14",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node14/solr/"}
   [junit4]   2> 1626799 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626799 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard6
   [junit4]   2> 1626801 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626801 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node20",
   [junit4]   2> 	  "core":"core20",
   [junit4]   2> 	  "core_node_name":"node20",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node20/solr/"}
   [junit4]   2> 1626801 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626802 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard9
   [junit4]   2> 1626803 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626803 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node12",
   [junit4]   2> 	  "core":"core12",
   [junit4]   2> 	  "core_node_name":"node12",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node12/solr/"}
   [junit4]   2> 1626803 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626804 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard5
   [junit4]   2> 1626805 T4114 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1626806 T4115 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=9 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node19",
   [junit4]   2> 	  "core":"core19",
   [junit4]   2> 	  "core_node_name":"node19",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"9",
   [junit4]   2> 	  "base_url":"http://node19/solr/"}
   [junit4]   2> 1626806 T4115 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=9
   [junit4]   2> 1626806 T4115 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1626807 T4114 oasc.

[...truncated too long message...]

olr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 1653487 T4594 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1653488 T4101 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:38072 38072
   [junit4]   2> 1653583 T4602 oasc.Overseer$ClusterStateUpdater.run WARN Solr cannot talk to ZK, exiting Overseer main queue loop org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.orderedChildren(DistributedQueue.java:99)
   [junit4]   2> 	at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:587)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:261)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1654107 T4602 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:38072_solr
   [junit4]   2> 1654107 T4582 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:38072 38072
   [junit4]   2> 1654108 T4604 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
   [junit4]   2> 
   [junit4]   2> 1654109 T4101 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest -Dtests.method=testOverseerFailure -Dtests.seed=738AC018F79C1A3A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr -Dtests.timezone=America/Nassau -Dtests.file.encoding=UTF-8
   [junit4] ERROR   3.51s J1 | OverseerTest.testOverseerFailure <<<
   [junit4]    > Throwable #1: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([738AC018F79C1A3A:77824FEBE539F51B]:0)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:329)
   [junit4]    > 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:142)
   [junit4]    > 	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:660)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1657116 T4101 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.OverseerTest-738AC018F79C1A3A-001
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=fr, timezone=America/Nassau
   [junit4]   2> NOTE: Linux 3.13.0-32-generic amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=8,threads=1,free=222106912,total=367001600
   [junit4]   2> NOTE: All tests run in this JVM: [ChaosMonkeySafeLeaderTest, TestInitQParser, TestUniqueKeyFieldResource, CoreContainerCoreInitFailuresTest, ModifyConfFileTest, TestSolrQueryParserDefaultOperatorResource, AtomicUpdatesTest, TestCSVResponseWriter, BlockDirectoryTest, DistribDocExpirationUpdateProcessorTest, TestCoreContainer, IndexSchemaRuntimeFieldTest, SampleTest, TestReRankQParserPlugin, TestManagedResourceStorage, BinaryUpdateRequestHandlerTest, StatsComponentTest, SSLMigrationTest, TestQuerySenderNoQuery, TestFieldCollectionResource, TestSuggestSpellingConverter, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, HdfsBasicDistributedZkTest, SolrIndexConfigTest, UpdateRequestProcessorFactoryTest, TestCollapseQParserPlugin, RequestHandlersTest, TestSolrQueryParser, TestRTGBase, TestRecoveryHdfs, TestJmxMonitoredMap, FunctionTest, QueryParsingTest, EnumFieldTest, HdfsCollectionsAPIDistributedZkTest, OutputWriterTest, AssignTest, SortByFunctionTest, LegacyHTMLStripCharFilterTest, BasicDistributedZk2Test, RemoteQueryErrorTest, URLClassifyProcessorTest, TestSystemIdResolver, TestSolrXMLSerializer, ShardSplitTest, DistributedExpandComponentTest, ZkSolrClientTest, TestSolrXmlPersistence, FullSolrCloudDistribCmdsTest, SliceStateTest, AutoCommitTest, HardAutoCommitTest, HdfsBasicDistributedZk2Test, BasicZkTest, TestDefaultSearchFieldResource, TestPerFieldSimilarity, SolrCoreTest, MultiTermTest, TestAtomicUpdateErrorCases, CacheHeaderTest, TestQueryTypes, SOLR749Test, QueryElevationComponentTest, TestXIncludeConfig, UUIDFieldTest, DistributedTermsComponentTest, CircularListTest, TestReloadAndDeleteDocs, TestLFUCache, TestOmitPositions, TestBinaryField, SolrPluginUtilsTest, TestSimpleQParserPlugin, TestAddFieldRealTimeGet, MigrateRouteKeyTest, DistanceFunctionTest, DirectSolrConnectionTest, DirectUpdateHandlerOptimizeTest, LoggingHandlerTest, TestMultiCoreConfBootstrap, CoreAdminRequestStatusTest, AnalysisErrorHandlingTest, SearchHandlerTest, AbstractAnalyticsFacetTest, AddSchemaFieldsUpdateProcessorFactoryTest, DistributedDebugComponentTest, OverseerRolesTest, TestSchemaSimilarityResource, OpenCloseCoreStressTest, TestPHPSerializedResponseWriter, TermVectorComponentDistributedTest, TestFileDictionaryLookup, HdfsWriteToMultipleCollectionsTest, TestRealTimeGet, HdfsSyncSliceTest, SuggesterFSTTest, ConnectionManagerTest, TestMiniSolrCloudCluster, TestFunctionQuery, TestIBSimilarityFactory, TestLazyCores, NumericFieldsTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OverseerTest]
   [junit4] Completed on J1 in 31.08s, 9 tests, 1 error <<< FAILURES!

[...truncated 723 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 419 suites, 1712 tests, 1 error, 38 ignored (17 assumptions)

Total time: 80 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_65 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Mime
View raw message