lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@sd-datasolutions.de>
Subject [JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_07) - Build # 1388 - Failure!
Date Wed, 31 Oct 2012 23:26:48 GMT
Build: http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Windows/1388/
Java: 32bit/jdk1.7.0_07 -client -XX:+UseConcMarkSweepGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testShardLeaderChange

Error Message:
Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>

Stack Trace:
org.junit.ComparisonFailure: Unexpected shard leader coll:collection1 shard:shard1 expected:<core[4]> but was:<core[1]>
	at __randomizedtesting.SeedInfo.seed([3D70FFC6994FA52F:E323783183D750DE]:0)
	at org.junit.Assert.assertEquals(Assert.java:125)
	at org.apache.solr.cloud.OverseerTest.verifyShardLeader(OverseerTest.java:493)
	at org.apache.solr.cloud.OverseerTest.testShardLeaderChange(OverseerTest.java:652)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 8797 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4]   2> 0 T1967 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351725338840
[junit4:junit4]   2> 1 T1967 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 12 T1967 oas.SolrTestCaseJ4.setUp ###Starting testReplay
[junit4:junit4]   2> 12 T1967 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 16 T1968 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 17 T1968 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 18 T1968 oazsp.FileTxnSnapLog.save Snapshotting: 0
[junit4:junit4]   2> 86 T1967 oasc.ZkTestServer.run start zk server on port:50559
[junit4:junit4]   2> 86 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50559/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@14396fa
[junit4:junit4]   2> 87 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 87 T1973 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50559
[junit4:junit4]   2> 89 T1973 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50559, initiating session
[junit4:junit4]   2> 89 T1969 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50562
[junit4:junit4]   2> 90 T1969 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50562
[junit4:junit4]   2> 91 T1971 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4]   2> 96 T1971 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd0ec0000 with negotiated timeout 10000 for client /127.0.0.1:50562
[junit4:junit4]   2> 96 T1973 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50559, sessionid = 0x13ab91bd0ec0000, negotiated timeout = 10000
[junit4:junit4]   2> 97 T1974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14396fa name:ZooKeeperConnection Watcher:127.0.0.1:50559/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 97 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 97 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50559 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@aad234
[junit4:junit4]   2> 98 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 98 T1975 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50559
[junit4:junit4]   2> 99 T1975 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50559, initiating session
[junit4:junit4]   2> 99 T1969 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50565
[junit4:junit4]   2> 100 T1969 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50565
[junit4:junit4]   2> 101 T1971 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd0ec0001 with negotiated timeout 10000 for client /127.0.0.1:50565
[junit4:junit4]   2> 101 T1975 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50559, sessionid = 0x13ab91bd0ec0001, negotiated timeout = 10000
[junit4:junit4]   2> 101 T1976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aad234 name:ZooKeeperConnection Watcher:127.0.0.1:50559 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 102 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 103 T1972 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd0ec0001
[junit4:junit4]   2> 103 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd0ec0001 closed
[junit4:junit4]   2> 104 T1969 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd0ec0001, likely client has closed socket
[junit4:junit4]   2> 104 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50559 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@12fff98
[junit4:junit4]   2> 104 T1976 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 104 T1969 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50565 which had sessionid 0x13ab91bd0ec0001
[junit4:junit4]   2> 105 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 105 T1977 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50559
[junit4:junit4]   2> 107 T1977 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50559, initiating session
[junit4:junit4]   2> 107 T1969 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50568
[junit4:junit4]   2> 108 T1969 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50568
[junit4:junit4]   2> 108 T1971 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd0ec0002 with negotiated timeout 10000 for client /127.0.0.1:50568
[junit4:junit4]   2> 108 T1977 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50559, sessionid = 0x13ab91bd0ec0002, negotiated timeout = 10000
[junit4:junit4]   2> 109 T1978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12fff98 name:ZooKeeperConnection Watcher:127.0.0.1:50559 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 109 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 110 T1967 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 112 T1972 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd0ec0002
[junit4:junit4]   2> 113 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd0ec0002 closed
[junit4:junit4]   2> 113 T1969 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd0ec0002, likely client has closed socket
[junit4:junit4]   2> 113 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 113 T1969 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50568 which had sessionid 0x13ab91bd0ec0002
[junit4:junit4]   2> 113 T1978 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 115 T1967 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 118 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 121 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0000 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 125 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50559/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@8c6db5
[junit4:junit4]   2> 126 T1979 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50559
[junit4:junit4]   2> 126 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 126 T1979 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50559, initiating session
[junit4:junit4]   2> 126 T1969 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50571
[junit4:junit4]   2> 127 T1969 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50571
[junit4:junit4]   2> 128 T1971 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd0ec0003 with negotiated timeout 10000 for client /127.0.0.1:50571
[junit4:junit4]   2> 128 T1979 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50559, sessionid = 0x13ab91bd0ec0003, negotiated timeout = 10000
[junit4:junit4]   2> 129 T1980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c6db5 name:ZooKeeperConnection Watcher:127.0.0.1:50559/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 129 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 129 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 134 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 136 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 138 T1967 oasc.Overseer.start Overseer (id=88586671807528963-127.0.0.1:50559_solr-n_0000000000) starting
[junit4:junit4]   2> 139 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0003 type:create cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 140 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 141 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 143 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 145 T1982 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 145 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0000 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 146 T1972 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd0ec0000 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 150 T1981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 151 T1981 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
[junit4:junit4]   2> 151 T1981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 152 T1974 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 156 T1981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core2",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 158 T1974 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 161 T1981 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 164 T1981 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 165 T1981 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "shard":"s1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 169 T1974 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 224 T1972 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd0ec0003
[junit4:junit4]   2> 225 T1969 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50571 which had sessionid 0x13ab91bd0ec0003
[junit4:junit4]   2> 225 T1980 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 225 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd0ec0003 closed
[junit4:junit4]   2> 225 T1972 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd0ec0000
[junit4:junit4]   2> 227 T1969 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50562 which had sessionid 0x13ab91bd0ec0000
[junit4:junit4]   2> 227 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd0ec0000 closed
[junit4:junit4]   2> 227 T1974 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 227 T1972 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 227 T1971 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 228 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 530 T1981 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 878 T1970 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 1844 T1969 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 1844 T1981 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88586671807528963-127.0.0.1:50559_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 1845 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 1845 T1967 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
[junit4:junit4]   2> 1847 T1967 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
[junit4:junit4]   2> 1847 T1967 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 1848 T1983 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 1849 T1983 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 1849 T1983 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351725338840\zookeeper\server1\data\version-2\snapshot.0
[junit4:junit4]   2> 1851 T1983 oazsp.FileTxnSnapLog.save Snapshotting: 26
[junit4:junit4]   2> 1920 T1967 oasc.ZkTestServer.run start zk server on port:50574
[junit4:junit4]   2> 1920 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50574/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f811cd
[junit4:junit4]   2> 1922 T1988 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50574
[junit4:junit4]   2> 1922 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1924 T1988 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50574, initiating session
[junit4:junit4]   2> 1925 T1984 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50577
[junit4:junit4]   2> 1925 T1984 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50577
[junit4:junit4]   2> 1926 T1986 oazsp.FileTxnLog.append Creating new log file: log.27
[junit4:junit4]   2> 1932 T1986 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd8140000 with negotiated timeout 10000 for client /127.0.0.1:50577
[junit4:junit4]   2> 1932 T1988 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50574, sessionid = 0x13ab91bd8140000, negotiated timeout = 10000
[junit4:junit4]   2> 1933 T1989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f811cd name:ZooKeeperConnection Watcher:127.0.0.1:50574/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1933 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1933 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50574 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1abb321
[junit4:junit4]   2> 1934 T1990 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50574
[junit4:junit4]   2> 1934 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1935 T1990 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50574, initiating session
[junit4:junit4]   2> 1935 T1984 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50580
[junit4:junit4]   2> 1935 T1984 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50580
[junit4:junit4]   2> 1936 T1986 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd8140001 with negotiated timeout 10000 for client /127.0.0.1:50580
[junit4:junit4]   2> 1936 T1990 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50574, sessionid = 0x13ab91bd8140001, negotiated timeout = 10000
[junit4:junit4]   2> 1936 T1991 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1abb321 name:ZooKeeperConnection Watcher:127.0.0.1:50574 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1937 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1954 T1987 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd8140001
[junit4:junit4]   2> 1955 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd8140001 closed
[junit4:junit4]   2> 1955 T1984 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd8140001, likely client has closed socket
[junit4:junit4]   2> 1955 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50574 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@abc38d
[junit4:junit4]   2> 1955 T1984 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50580 which had sessionid 0x13ab91bd8140001
[junit4:junit4]   2> 1956 T1991 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1957 T1992 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50574
[junit4:junit4]   2> 1957 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1958 T1992 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50574, initiating session
[junit4:junit4]   2> 1958 T1984 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50583
[junit4:junit4]   2> 1958 T1984 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50583
[junit4:junit4]   2> 1960 T1986 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd8140002 with negotiated timeout 10000 for client /127.0.0.1:50583
[junit4:junit4]   2> 1960 T1992 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50574, sessionid = 0x13ab91bd8140002, negotiated timeout = 10000
[junit4:junit4]   2> 1961 T1993 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@abc38d name:ZooKeeperConnection Watcher:127.0.0.1:50574 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1961 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1961 T1967 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 1965 T1987 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd8140002
[junit4:junit4]   2> 1966 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd8140002 closed
[junit4:junit4]   2> 1966 T1984 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd8140002, likely client has closed socket
[junit4:junit4]   2> 1966 T1993 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 1966 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 1966 T1984 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50583 which had sessionid 0x13ab91bd8140002
[junit4:junit4]   2> 1969 T1967 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 1971 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1973 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50574/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1aee626
[junit4:junit4]   2> 1974 T1994 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50574
[junit4:junit4]   2> 1974 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1976 T1994 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50574, initiating session
[junit4:junit4]   2> 1976 T1984 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50586
[junit4:junit4]   2> 1976 T1984 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50586
[junit4:junit4]   2> 1977 T1986 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd8140003 with negotiated timeout 10000 for client /127.0.0.1:50586
[junit4:junit4]   2> 1977 T1994 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50574, sessionid = 0x13ab91bd8140003, negotiated timeout = 10000
[junit4:junit4]   2> 1978 T1995 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aee626 name:ZooKeeperConnection Watcher:127.0.0.1:50574/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1978 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1978 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 1980 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 1983 T1995 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 1983 T1989 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 1984 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50574/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@11665ca
[junit4:junit4]   2> 1985 T1996 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50574
[junit4:junit4]   2> 1985 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 1986 T1996 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50574, initiating session
[junit4:junit4]   2> 1986 T1984 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50589
[junit4:junit4]   2> 1986 T1984 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50589
[junit4:junit4]   2> 1988 T1986 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd8140004 with negotiated timeout 10000 for client /127.0.0.1:50589
[junit4:junit4]   2> 1988 T1996 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50574, sessionid = 0x13ab91bd8140004, negotiated timeout = 10000
[junit4:junit4]   2> 1989 T1997 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11665ca name:ZooKeeperConnection Watcher:127.0.0.1:50574/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 1989 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 1990 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 1995 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140004 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 1995 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 1997 T1967 oasc.Overseer.start Overseer (id=88586671927590916-127.0.0.1:50574_solr-n_0000000000) starting
[junit4:junit4]   2> 1999 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140004 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2000 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140004 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2002 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140004 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2003 T1999 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 2004 T1998 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 2672 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 2674 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 3002 T1998 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3002 T1998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 3002 T1998 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 3003 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140004 type:create cxid:0x26 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 3009 T1995 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3009 T1989 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3323 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3335 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:delete cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 3335 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 3340 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0x25 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3343 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3344 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 3346 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3348 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0x2e zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 3659 T1998 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 3661 T1998 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 3666 T1995 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3666 T1989 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 3700 T1987 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd8140004
[junit4:junit4]   2> 3700 T1984 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd8140004, likely client has closed socket
[junit4:junit4]   2> 3700 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd8140004 closed
[junit4:junit4]   2> 3701 T1997 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 3701 T1984 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50589 which had sessionid 0x13ab91bd8140004
[junit4:junit4]   2> 3992 T1998 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 3992 T1998 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88586671927590916-127.0.0.1:50574_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 4346 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0x34 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4349 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4350 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0x3b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4354 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50574/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@a63a01
[junit4:junit4]   2> 4354 T2000 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50574
[junit4:junit4]   2> 4354 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 4355 T2000 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50574, initiating session
[junit4:junit4]   2> 4355 T1984 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50592
[junit4:junit4]   2> 4355 T1984 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50592
[junit4:junit4]   2> 4357 T1986 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bd8140005 with negotiated timeout 10000 for client /127.0.0.1:50592
[junit4:junit4]   2> 4357 T2000 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50574, sessionid = 0x13ab91bd8140005, negotiated timeout = 10000
[junit4:junit4]   2> 4357 T2001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a63a01 name:ZooKeeperConnection Watcher:127.0.0.1:50574/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 4357 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 4360 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140005 type:delete cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 4361 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 4373 T1967 oasc.Overseer.start Overseer (id=88586671927590917-127.0.0.1:50574_solr-n_0000000002) starting
[junit4:junit4]   2> 4373 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140005 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4374 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140005 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4375 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140005 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4376 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140005 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4378 T2003 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 4378 T2002 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 4380 T2002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4381 T2002 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 4385 T1995 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 4385 T1989 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 4419 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0x41 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 4421 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4424 T1987 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bd8140003 type:create cxid:0x48 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 4711 T2002 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 4717 T1995 oasc.LeaderElector.checkIfIamLeader WARNING Our node is no longer in line to be leader
[junit4:junit4]   2> 4719 T1995 oasc.LeaderElector.checkIfIamLeader WARNING Our node is no longer in line to be leader
[junit4:junit4]   2> 4719 T1995 oasc.LeaderElector.checkIfIamLeader WARNING Our node is no longer in line to be leader
[junit4:junit4]   2> 4729 T1995 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 4729 T1989 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 5054 T1995 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 5055 T1987 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd8140003
[junit4:junit4]   2> 5055 T1984 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd8140003, likely client has closed socket
[junit4:junit4]   2> 5055 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd8140003 closed
[junit4:junit4]   2> 5056 T1984 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50586 which had sessionid 0x13ab91bd8140003
[junit4:junit4]   2> 5056 T1989 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 5056 T1989 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 5057 T1987 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd8140005
[junit4:junit4]   2> 5057 T1984 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd8140005, likely client has closed socket
[junit4:junit4]   2> 5057 T2001 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5057 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd8140005 closed
[junit4:junit4]   2> 5057 T1984 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50592 which had sessionid 0x13ab91bd8140005
[junit4:junit4]   2> 5059 T1987 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bd8140000
[junit4:junit4]   2> 5059 T1984 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bd8140000, likely client has closed socket
[junit4:junit4]   2> 5059 T1989 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 5059 T1967 oaz.ZooKeeper.close Session: 0x13ab91bd8140000 closed
[junit4:junit4]   2> 5059 T1984 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50577 which had sessionid 0x13ab91bd8140000
[junit4:junit4]   2> 5060 T1987 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 5060 T1986 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 5061 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 5115 T1985 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 5702 T2002 oasc.Overseer$ClusterStateUpdater.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 6517 T1984 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 5701 T1995 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 6518 T1995 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 6518 T1995 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6520 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 6521 T1967 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
[junit4:junit4]   2> 6523 T1967 oas.SolrTestCaseJ4.setUp ###Starting testDoubleAssignment
[junit4:junit4]   2> 6523 T1967 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 6524 T2004 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 6525 T2004 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 6525 T2004 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351725338840\zookeeper\server1\data\version-2\snapshot.26
[junit4:junit4]   2> 6527 T2004 oazsp.FileTxnSnapLog.save Snapshotting: 8b
[junit4:junit4]   2> 6589 T1967 oasc.ZkTestServer.run start zk server on port:50595
[junit4:junit4]   2> 6589 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50595/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@195afa5
[junit4:junit4]   2> 6590 T2009 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50595
[junit4:junit4]   2> 6590 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6591 T2009 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50595, initiating session
[junit4:junit4]   2> 6592 T2005 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50598
[junit4:junit4]   2> 6592 T2005 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50598
[junit4:junit4]   2> 6592 T2007 oazsp.FileTxnLog.append Creating new log file: log.8c
[junit4:junit4]   2> 6595 T2007 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bea590000 with negotiated timeout 10000 for client /127.0.0.1:50598
[junit4:junit4]   2> 6595 T2009 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50595, sessionid = 0x13ab91bea590000, negotiated timeout = 10000
[junit4:junit4]   2> 6596 T2010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@195afa5 name:ZooKeeperConnection Watcher:127.0.0.1:50595/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6596 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6596 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50595 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b63a79
[junit4:junit4]   2> 6597 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6597 T2011 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50595
[junit4:junit4]   2> 6599 T2011 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50595, initiating session
[junit4:junit4]   2> 6599 T2005 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50601
[junit4:junit4]   2> 6599 T2005 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50601
[junit4:junit4]   2> 6600 T2007 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bea590001 with negotiated timeout 10000 for client /127.0.0.1:50601
[junit4:junit4]   2> 6600 T2011 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50595, sessionid = 0x13ab91bea590001, negotiated timeout = 10000
[junit4:junit4]   2> 6600 T2012 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b63a79 name:ZooKeeperConnection Watcher:127.0.0.1:50595 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6600 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6614 T2008 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bea590001
[junit4:junit4]   2> 6616 T2012 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6616 T1967 oaz.ZooKeeper.close Session: 0x13ab91bea590001 closed
[junit4:junit4]   2> 6616 T2005 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bea590001, likely client has closed socket
[junit4:junit4]   2> 6616 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50595 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@12e8662
[junit4:junit4]   2> 6616 T2005 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50601 which had sessionid 0x13ab91bea590001
[junit4:junit4]   2> 6617 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6617 T2013 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50595
[junit4:junit4]   2> 6618 T2013 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50595, initiating session
[junit4:junit4]   2> 6619 T2005 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50604
[junit4:junit4]   2> 6619 T2005 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50604
[junit4:junit4]   2> 6620 T2007 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bea590002 with negotiated timeout 10000 for client /127.0.0.1:50604
[junit4:junit4]   2> 6620 T2013 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50595, sessionid = 0x13ab91bea590002, negotiated timeout = 10000
[junit4:junit4]   2> 6620 T2014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12e8662 name:ZooKeeperConnection Watcher:127.0.0.1:50595 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6621 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6621 T1967 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 6623 T2008 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bea590002
[junit4:junit4]   2> 6624 T2014 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 6624 T2005 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bea590002, likely client has closed socket
[junit4:junit4]   2> 6624 T2005 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50604 which had sessionid 0x13ab91bea590002
[junit4:junit4]   2> 6624 T1967 oaz.ZooKeeper.close Session: 0x13ab91bea590002 closed
[junit4:junit4]   2> 6624 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 6627 T1967 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 6629 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6630 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50595/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@b27842
[junit4:junit4]   2> 6631 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6631 T2015 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50595
[junit4:junit4]   2> 6632 T2015 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50595, initiating session
[junit4:junit4]   2> 6632 T2005 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50607
[junit4:junit4]   2> 6633 T2005 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50607
[junit4:junit4]   2> 6634 T2007 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bea590003 with negotiated timeout 10000 for client /127.0.0.1:50607
[junit4:junit4]   2> 6634 T2015 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50595, sessionid = 0x13ab91bea590003, negotiated timeout = 10000
[junit4:junit4]   2> 6634 T2016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b27842 name:ZooKeeperConnection Watcher:127.0.0.1:50595/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6635 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6635 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 6636 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 6640 T2016 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 6640 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50595/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d284fd
[junit4:junit4]   2> 6640 T2010 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 6640 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 6640 T2017 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50595
[junit4:junit4]   2> 6641 T2017 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50595, initiating session
[junit4:junit4]   2> 6641 T2005 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50610
[junit4:junit4]   2> 6642 T2005 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50610
[junit4:junit4]   2> 6643 T2007 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bea590004 with negotiated timeout 10000 for client /127.0.0.1:50610
[junit4:junit4]   2> 6643 T2017 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50595, sessionid = 0x13ab91bea590004, negotiated timeout = 10000
[junit4:junit4]   2> 6643 T2018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d284fd name:ZooKeeperConnection Watcher:127.0.0.1:50595/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 6644 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 6644 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 6649 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590004 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 6650 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 6651 T1967 oasc.Overseer.start Overseer (id=88586672234102788-127.0.0.1:50595_solr-n_0000000000) starting
[junit4:junit4]   2> 6653 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590004 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6654 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590004 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6655 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590004 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6657 T2020 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 6657 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590003 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 6658 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590003 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 6660 T2019 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 6663 T2019 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 6663 T2019 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 6663 T2019 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4]   2> 6664 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590004 type:create cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 6670 T2010 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 6670 T2016 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 6985 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7002 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590003 type:delete cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 7003 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7012 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590003 type:create cxid:0x25 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7015 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7019 T2010 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 7020 T2008 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bea590003
[junit4:junit4]   2> 7020 T2016 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 7020 T2016 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 7023 T2005 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50607 which had sessionid 0x13ab91bea590003
[junit4:junit4]   2> 7022 T1967 oaz.ZooKeeper.close Session: 0x13ab91bea590003 closed
[junit4:junit4]   2> 7024 T2010 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 7024 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50595/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dfe772
[junit4:junit4]   2> 7026 T2021 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50595
[junit4:junit4]   2> 7026 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 7027 T2021 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50595, initiating session
[junit4:junit4]   2> 7028 T2005 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50613
[junit4:junit4]   2> 7029 T2005 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50613
[junit4:junit4]   2> 7031 T2007 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bea590005 with negotiated timeout 10000 for client /127.0.0.1:50613
[junit4:junit4]   2> 7031 T2021 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50595, sessionid = 0x13ab91bea590005, negotiated timeout = 10000
[junit4:junit4]   2> 7031 T2022 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dfe772 name:ZooKeeperConnection Watcher:127.0.0.1:50595/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 7032 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 7033 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 7036 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 7039 T2010 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 7041 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590005 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7041 T2022 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 7042 T2010 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 7044 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7048 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590005 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 7053 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590005 type:delete cxid:0x14 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard1 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard1
[junit4:junit4]   2> 7054 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 7059 T2008 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bea590005 type:create cxid:0x1b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 7320 T2019 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7323 T2019 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://node1/solr/"}
[junit4:junit4]   2> 7329 T2010 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 7329 T2022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 7331 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 7332 T2008 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bea590004
[junit4:junit4]   2> 7333 T1967 oaz.ZooKeeper.close Session: 0x13ab91bea590004 closed
[junit4:junit4]   2> 7333 T2018 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7333 T2005 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50610 which had sessionid 0x13ab91bea590004
[junit4:junit4]   2> 7334 T2010 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 7334 T2008 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bea590005
[junit4:junit4]   2> 7336 T2022 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 7336 T2022 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 7336 T2005 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bea590005, likely client has closed socket
[junit4:junit4]   2> 7336 T1967 oaz.ZooKeeper.close Session: 0x13ab91bea590005 closed
[junit4:junit4]   2> 7336 T2005 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50613 which had sessionid 0x13ab91bea590005
[junit4:junit4]   2> 7337 T2008 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bea590000
[junit4:junit4]   2> 7338 T2005 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50598 which had sessionid 0x13ab91bea590000
[junit4:junit4]   2> 7339 T1967 oaz.ZooKeeper.close Session: 0x13ab91bea590000 closed
[junit4:junit4]   2> 7339 T2007 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 7339 T2008 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 7339 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 7667 T2016 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 7983 T2010 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 7981 T2022 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 7978 T2019 oasc.Overseer$ClusterStateUpdater.run WARNING Overseer cannot talk to ZK
[junit4:junit4]   2> 8805 T2022 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 7805 T2006 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 8805 T2005 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 8803 T2016 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8806 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 8807 T2010 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8807 T1967 oas.SolrTestCaseJ4.tearDown ###Ending testDoubleAssignment
[junit4:junit4]   2> 8810 T1967 oas.SolrTestCaseJ4.setUp ###Starting testStateChange
[junit4:junit4]   2> 8810 T1967 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 8811 T2023 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 8812 T2023 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 8812 T2023 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351725338840\zookeeper\server1\data\version-2\snapshot.8b
[junit4:junit4]   2> 8814 T2023 oazsp.FileTxnSnapLog.save Snapshotting: d7
[junit4:junit4]   2> 8882 T1967 oasc.ZkTestServer.run start zk server on port:50616
[junit4:junit4]   2> 8882 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50616/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1221aa7
[junit4:junit4]   2> 8884 T2028 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50616
[junit4:junit4]   2> 8884 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8884 T2028 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50616, initiating session
[junit4:junit4]   2> 8884 T2024 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50619
[junit4:junit4]   2> 8885 T2024 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50619
[junit4:junit4]   2> 8885 T2026 oazsp.FileTxnLog.append Creating new log file: log.d8
[junit4:junit4]   2> 8888 T2026 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bf3470000 with negotiated timeout 10000 for client /127.0.0.1:50619
[junit4:junit4]   2> 8888 T2028 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50616, sessionid = 0x13ab91bf3470000, negotiated timeout = 10000
[junit4:junit4]   2> 8889 T2029 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1221aa7 name:ZooKeeperConnection Watcher:127.0.0.1:50616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8889 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8889 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50616 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1047e5c
[junit4:junit4]   2> 8890 T2030 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50616
[junit4:junit4]   2> 8891 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8891 T2030 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50616, initiating session
[junit4:junit4]   2> 8891 T2024 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50622
[junit4:junit4]   2> 8891 T2024 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50622
[junit4:junit4]   2> 8893 T2026 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bf3470001 with negotiated timeout 10000 for client /127.0.0.1:50622
[junit4:junit4]   2> 8893 T2030 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50616, sessionid = 0x13ab91bf3470001, negotiated timeout = 10000
[junit4:junit4]   2> 8893 T2031 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1047e5c name:ZooKeeperConnection Watcher:127.0.0.1:50616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8893 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8914 T2027 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bf3470001
[junit4:junit4]   2> 8915 T1967 oaz.ZooKeeper.close Session: 0x13ab91bf3470001 closed
[junit4:junit4]   2> 8915 T2024 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bf3470001, likely client has closed socket
[junit4:junit4]   2> 8915 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50616 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@4fa6a0
[junit4:junit4]   2> 8916 T2024 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50622 which had sessionid 0x13ab91bf3470001
[junit4:junit4]   2> 8916 T2031 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8916 T2032 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50616
[junit4:junit4]   2> 8916 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8917 T2032 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50616, initiating session
[junit4:junit4]   2> 8918 T2024 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50625
[junit4:junit4]   2> 8918 T2024 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50625
[junit4:junit4]   2> 8918 T2026 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bf3470002 with negotiated timeout 10000 for client /127.0.0.1:50625
[junit4:junit4]   2> 8919 T2032 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50616, sessionid = 0x13ab91bf3470002, negotiated timeout = 10000
[junit4:junit4]   2> 8919 T2033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fa6a0 name:ZooKeeperConnection Watcher:127.0.0.1:50616 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8919 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8920 T1967 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 8921 T2027 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bf3470002
[junit4:junit4]   2> 8923 T1967 oaz.ZooKeeper.close Session: 0x13ab91bf3470002 closed
[junit4:junit4]   2> 8923 T2024 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bf3470002, likely client has closed socket
[junit4:junit4]   2> 8923 T2033 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 8923 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 8923 T2024 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50625 which had sessionid 0x13ab91bf3470002
[junit4:junit4]   2> 8925 T1967 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 8927 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 8928 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50616/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18b765b
[junit4:junit4]   2> 8929 T2034 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50616
[junit4:junit4]   2> 8929 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 8930 T2034 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50616, initiating session
[junit4:junit4]   2> 8930 T2024 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50628
[junit4:junit4]   2> 8930 T2024 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50628
[junit4:junit4]   2> 8932 T2026 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bf3470003 with negotiated timeout 10000 for client /127.0.0.1:50628
[junit4:junit4]   2> 8932 T2034 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50616, sessionid = 0x13ab91bf3470003, negotiated timeout = 10000
[junit4:junit4]   2> 8932 T2035 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b765b name:ZooKeeperConnection Watcher:127.0.0.1:50616/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 8932 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 8932 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 8937 T2027 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bf3470003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 8938 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 8940 T1967 oasc.Overseer.start Overseer (id=88586672383918083-127.0.0.1:50616_solr-n_0000000000) starting
[junit4:junit4]   2> 8941 T2027 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bf3470003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8943 T2027 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bf3470003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8943 T2027 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bf3470003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8945 T2037 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 8945 T2027 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bf3470000 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 8946 T2027 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bf3470000 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 8947 T2036 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 8950 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 8987 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9024 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9061 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9099 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9135 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9172 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9209 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9246 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9282 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9307 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9307 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"recovering",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 9307 T2027 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bf3470003 type:create cxid:0x20 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 9316 T2029 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 9320 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9676 T2036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 9677 T2036 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"node1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
[junit4:junit4]   2> 	  "roles":""}
[junit4:junit4]   2> 9683 T2029 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 9683 T2027 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bf3470000
[junit4:junit4]   2> 9685 T2024 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bf3470000, likely client has closed socket
[junit4:junit4]   2> 9685 T2029 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9685 T1967 oaz.ZooKeeper.close Session: 0x13ab91bf3470000 closed
[junit4:junit4]   2> 9685 T2024 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50619 which had sessionid 0x13ab91bf3470000
[junit4:junit4]   2> 9687 T2027 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bf3470003
[junit4:junit4]   2> 9688 T1967 oaz.ZooKeeper.close Session: 0x13ab91bf3470003 closed
[junit4:junit4]   2> 9688 T2024 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bf3470003, likely client has closed socket
[junit4:junit4]   2> 9688 T2026 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 9689 T2024 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50628 which had sessionid 0x13ab91bf3470003
[junit4:junit4]   2> 9689 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 9688 T2027 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 9688 T2035 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 9871 T2025 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 10041 T2036 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 11288 T2024 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 11289 T2036 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88586672383918083-127.0.0.1:50616_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 11290 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 11291 T1967 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
[junit4:junit4]   2> 11295 T1967 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignment
[junit4:junit4]   2> 11295 T1967 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 11297 T2038 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 11298 T2038 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 11298 T2038 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351725338840\zookeeper\server1\data\version-2\snapshot.d7
[junit4:junit4]   2> 11298 T2038 oazsp.FileTxnSnapLog.save Snapshotting: 10c
[junit4:junit4]   2> 11368 T1967 oasc.ZkTestServer.run start zk server on port:50631
[junit4:junit4]   2> 11368 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50631 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@19cd6aa
[junit4:junit4]   2> 11370 T2043 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50631
[junit4:junit4]   2> 11370 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11371 T2043 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50631, initiating session
[junit4:junit4]   2> 11371 T2039 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50634
[junit4:junit4]   2> 11372 T2039 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50634
[junit4:junit4]   2> 11372 T2041 oazsp.FileTxnLog.append Creating new log file: log.10d
[junit4:junit4]   2> 11376 T2041 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bfcfd0000 with negotiated timeout 10000 for client /127.0.0.1:50634
[junit4:junit4]   2> 11376 T2043 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50631, sessionid = 0x13ab91bfcfd0000, negotiated timeout = 10000
[junit4:junit4]   2> 11377 T2044 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19cd6aa name:ZooKeeperConnection Watcher:127.0.0.1:50631 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11377 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11401 T2042 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bfcfd0000
[junit4:junit4]   2> 11402 T2039 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50634 which had sessionid 0x13ab91bfcfd0000
[junit4:junit4]   2> 11402 T1967 oaz.ZooKeeper.close Session: 0x13ab91bfcfd0000 closed
[junit4:junit4]   2> 11402 T2044 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11402 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50631 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@165f51b
[junit4:junit4]   2> 11404 T2045 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50631
[junit4:junit4]   2> 11404 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11404 T2045 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50631, initiating session
[junit4:junit4]   2> 11405 T2039 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50637
[junit4:junit4]   2> 11405 T2039 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50637
[junit4:junit4]   2> 11407 T2041 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bfcfd0001 with negotiated timeout 10000 for client /127.0.0.1:50637
[junit4:junit4]   2> 11407 T2045 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50631, sessionid = 0x13ab91bfcfd0001, negotiated timeout = 10000
[junit4:junit4]   2> 11407 T2046 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@165f51b name:ZooKeeperConnection Watcher:127.0.0.1:50631 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11407 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11407 T1967 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 11410 T2042 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bfcfd0001
[junit4:junit4]   2> 11412 T2039 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50637 which had sessionid 0x13ab91bfcfd0001
[junit4:junit4]   2> 11412 T2046 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 11412 T1967 oaz.ZooKeeper.close Session: 0x13ab91bfcfd0001 closed
[junit4:junit4]   2> 11413 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50631/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ede015
[junit4:junit4]   2> 11414 T2047 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50631
[junit4:junit4]   2> 11414 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11415 T2047 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50631, initiating session
[junit4:junit4]   2> 11415 T2039 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50640
[junit4:junit4]   2> 11415 T2039 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50640
[junit4:junit4]   2> 11417 T2041 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bfcfd0002 with negotiated timeout 10000 for client /127.0.0.1:50640
[junit4:junit4]   2> 11417 T2047 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50631, sessionid = 0x13ab91bfcfd0002, negotiated timeout = 10000
[junit4:junit4]   2> 11417 T2048 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ede015 name:ZooKeeperConnection Watcher:127.0.0.1:50631/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11418 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11418 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 11421 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50631/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b38af0
[junit4:junit4]   2> 11422 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11422 T2049 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50631
[junit4:junit4]   2> 11424 T2049 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50631, initiating session
[junit4:junit4]   2> 11424 T2039 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50643
[junit4:junit4]   2> 11424 T2039 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50643
[junit4:junit4]   2> 11428 T2049 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50631, sessionid = 0x13ab91bfcfd0003, negotiated timeout = 10000
[junit4:junit4]   2> 11428 T2041 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bfcfd0003 with negotiated timeout 10000 for client /127.0.0.1:50643
[junit4:junit4]   2> 11428 T2050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b38af0 name:ZooKeeperConnection Watcher:127.0.0.1:50631/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11428 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11429 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 11435 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 11436 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 11438 T1967 oasc.Overseer.start Overseer (id=88586672546840579-127.0.0.1:50631_solr-n_0000000000) starting
[junit4:junit4]   2> 11440 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11441 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11442 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11444 T2052 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 11445 T1967 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 11446 T2051 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 11448 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 11449 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50631/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@137f72a
[junit4:junit4]   2> 11450 T2053 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50631
[junit4:junit4]   2> 11450 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 11451 T2053 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50631, initiating session
[junit4:junit4]   2> 11452 T2039 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50646
[junit4:junit4]   2> 11452 T2039 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50646
[junit4:junit4]   2> 11453 T2041 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91bfcfd0004 with negotiated timeout 10000 for client /127.0.0.1:50646
[junit4:junit4]   2> 11453 T2053 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50631, sessionid = 0x13ab91bfcfd0004, negotiated timeout = 10000
[junit4:junit4]   2> 11453 T2054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@137f72a name:ZooKeeperConnection Watcher:127.0.0.1:50631/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 11454 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 11454 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 11456 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4:junit4]   2> 11460 T2054 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 11460 T2048 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 11460 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11461 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4]   2> 11806 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 11807 T2051 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core1",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4]   2> 11807 T2051 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4]   2> 11807 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0003 type:create cxid:0x20 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 11816 T2054 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 11816 T2048 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 11820 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 11835 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:delete cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 11836 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 11843 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x25 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 11846 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12177 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12186 T2051 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core2",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4]   2> 12191 T2048 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12191 T2054 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12203 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 12213 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:delete cxid:0x35 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4]   2> 12214 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4]   2> 12219 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x3c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12230 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x3e zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12551 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12557 T2051 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core3",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4]   2> 12563 T2054 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12563 T2048 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12592 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 12600 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:delete cxid:0x4c zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4]   2> 12601 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4]   2> 12604 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x53 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12607 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x55 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 12925 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 12931 T2051 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core4",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4]   2> 12936 T2048 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12936 T2054 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 12966 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 12969 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x5e zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 12972 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x62 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13297 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13298 T2051 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core5",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4]   2> 13302 T2054 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 13302 T2048 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 13330 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 13332 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x6b zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard2/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 13335 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x6f zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 13662 T2051 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 13663 T2051 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4]   2> 	  "state":"active",
[junit4:junit4]   2> 	  "operation":"state",
[junit4:junit4]   2> 	  "core":"core6",
[junit4:junit4]   2> 	  "numShards":"3",
[junit4:junit4]   2> 	  "collection":"collection1",
[junit4:junit4]   2> 	  "node_name":"127.0.0.1",
[junit4:junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4]   2> 13670 T2048 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 13671 T2054 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 13691 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 13695 T2042 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91bfcfd0004 type:create cxid:0x78 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard3/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 13701 T2042 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bfcfd0002
[junit4:junit4]   2> 13703 T2048 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13703 T2039 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bfcfd0002, likely client has closed socket
[junit4:junit4]   2> 13704 T2039 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50640 which had sessionid 0x13ab91bfcfd0002
[junit4:junit4]   2> 13703 T1967 oaz.ZooKeeper.close Session: 0x13ab91bfcfd0002 closed
[junit4:junit4]   2> 13708 T2042 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bfcfd0004
[junit4:junit4]   2> 13720 T2054 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 13720 T2054 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (0)
[junit4:junit4]   2> 13722 T1967 oaz.ZooKeeper.close Session: 0x13ab91bfcfd0004 closed
[junit4:junit4]   2> 13722 T2039 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91bfcfd0004, likely client has closed socket
[junit4:junit4]   2> 13722 T2039 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50646 which had sessionid 0x13ab91bfcfd0004
[junit4:junit4]   2> 13723 T2042 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91bfcfd0003
[junit4:junit4]   2> 13724 T2039 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50643 which had sessionid 0x13ab91bfcfd0003
[junit4:junit4]   2> 13724 T1967 oaz.ZooKeeper.close Session: 0x13ab91bfcfd0003 closed
[junit4:junit4]   2> 13724 T2050 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 13725 T2042 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 13725 T2041 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 13726 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 13871 T2040 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 14431 T2054 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 14031 T2051 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15327 T2054 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15327 T2039 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 15327 T2051 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88586672546840579-127.0.0.1:50631_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 15327 T2054 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15329 T2054 oasc.LeaderElector$1.process WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1249)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:227)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:224)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:83)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526)
[junit4:junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
[junit4:junit4]   2> 
[junit4:junit4]   2> 15329 T2054 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15329 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 15330 T1967 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
[junit4:junit4]   2> 15333 T1967 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4:junit4]   2> 15333 T1967 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4]   2> 15334 T2055 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4]   2> 15336 T2055 oazs.NIOServerCnxn$Factory.<init> binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4]   2> 15337 T2055 oazsp.FileSnap.deserialize Reading snapshot C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerTest-1351725338840\zookeeper\server1\data\version-2\snapshot.10c
[junit4:junit4]   2> 15339 T2055 oazsp.FileTxnSnapLog.save Snapshotting: 17e
[junit4:junit4]   2> 15406 T1967 oasc.ZkTestServer.run start zk server on port:50649
[junit4:junit4]   2> 15406 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2ad10d
[junit4:junit4]   2> 15407 T2060 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15407 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15408 T2060 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15408 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50652
[junit4:junit4]   2> 15409 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50652
[junit4:junit4]   2> 15410 T2058 oazsp.FileTxnLog.append Creating new log file: log.17f
[junit4:junit4]   2> 15413 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40000 with negotiated timeout 10000 for client /127.0.0.1:50652
[junit4:junit4]   2> 15413 T2060 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40000, negotiated timeout = 10000
[junit4:junit4]   2> 15414 T2061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ad10d name:ZooKeeperConnection Watcher:127.0.0.1:50649 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15414 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15447 T2059 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91c0cc40000
[junit4:junit4]   2> 15449 T1967 oaz.ZooKeeper.close Session: 0x13ab91c0cc40000 closed
[junit4:junit4]   2> 15449 T2056 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91c0cc40000, likely client has closed socket
[junit4:junit4]   2> 15449 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7c17a2
[junit4:junit4]   2> 15449 T2056 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50652 which had sessionid 0x13ab91c0cc40000
[junit4:junit4]   2> 15450 T2061 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15451 T2062 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15451 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15451 T2062 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15451 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50655
[junit4:junit4]   2> 15452 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50655
[junit4:junit4]   2> 15453 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40001 with negotiated timeout 10000 for client /127.0.0.1:50655
[junit4:junit4]   2> 15453 T2062 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40001, negotiated timeout = 10000
[junit4:junit4]   2> 15453 T2063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c17a2 name:ZooKeeperConnection Watcher:127.0.0.1:50649 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15453 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15454 T1967 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4]   2> 15456 T2059 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91c0cc40001
[junit4:junit4]   2> 15457 T1967 oaz.ZooKeeper.close Session: 0x13ab91c0cc40001 closed
[junit4:junit4]   2> 15457 T2063 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 15457 T2056 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91c0cc40001, likely client has closed socket
[junit4:junit4]   2> 15457 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@23f2a8
[junit4:junit4]   2> 15457 T2056 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50655 which had sessionid 0x13ab91c0cc40001
[junit4:junit4]   2> 15458 T2064 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15458 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15459 T2064 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15459 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50658
[junit4:junit4]   2> 15459 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50658
[junit4:junit4]   2> 15460 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40002 with negotiated timeout 10000 for client /127.0.0.1:50658
[junit4:junit4]   2> 15460 T2064 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40002, negotiated timeout = 10000
[junit4:junit4]   2> 15460 T2065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23f2a8 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15461 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15461 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4]   2> 15463 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@139b7cd
[junit4:junit4]   2> 15465 T2066 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15465 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15465 T2066 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15465 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50661
[junit4:junit4]   2> 15465 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50661
[junit4:junit4]   2> 15467 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40003 with negotiated timeout 10000 for client /127.0.0.1:50661
[junit4:junit4]   2> 15467 T2066 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40003, negotiated timeout = 10000
[junit4:junit4]   2> 15467 T2067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@139b7cd name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15467 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15468 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4]   2> 15473 T2059 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91c0cc40003 type:delete cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4]   2> 15474 T1967 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4]   2> 15476 T1967 oasc.Overseer.start Overseer (id=88586672811540483-127.0.0.1:50649_solr-n_0000000000) starting
[junit4:junit4]   2> 15478 T2059 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91c0cc40003 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15480 T2059 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91c0cc40003 type:create cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15481 T2059 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91c0cc40003 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 15483 T2069 oasc.OverseerCollectionProcessor.run Process current queue of collection messages
[junit4:junit4]   2> 15483 T1967 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4]   2> 15484 T2068 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4]   2> 15491 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15492 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@54579c
[junit4:junit4]   2> 15493 T2070 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15493 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15494 T2070 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15496 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50664
[junit4:junit4]   2> 15496 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50664
[junit4:junit4]   2> 15498 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40004 with negotiated timeout 10000 for client /127.0.0.1:50664
[junit4:junit4]   2> 15498 T2070 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40004, negotiated timeout = 10000
[junit4:junit4]   2> 15499 T2071 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54579c name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15499 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15499 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15501 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4:junit4]   2> 15505 T2065 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 15505 T2071 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4]   2> 15505 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d729b
[junit4:junit4]   2> 15505 T2072 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15505 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15507 T2072 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15507 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50667
[junit4:junit4]   2> 15508 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50667
[junit4:junit4]   2> 15509 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40005 with negotiated timeout 10000 for client /127.0.0.1:50667
[junit4:junit4]   2> 15509 T2072 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40005, negotiated timeout = 10000
[junit4:junit4]   2> 15510 T2073 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d729b name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15510 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15510 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15512 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4]   2> 15515 T2073 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 15516 T2065 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 15516 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c3976
[junit4:junit4]   2> 15516 T2071 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4]   2> 15517 T2074 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15517 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15518 T2074 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15518 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50670
[junit4:junit4]   2> 15519 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50670
[junit4:junit4]   2> 15520 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40006 with negotiated timeout 10000 for client /127.0.0.1:50670
[junit4:junit4]   2> 15520 T2074 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40006, negotiated timeout = 10000
[junit4:junit4]   2> 15521 T2075 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c3976 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15521 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15522 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15524 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4:junit4]   2> 15528 T2073 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 15528 T2075 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 15528 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@55b6b9
[junit4:junit4]   2> 15529 T2071 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 15529 T2065 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4]   2> 15529 T2076 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15529 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15530 T2076 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15530 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50673
[junit4:junit4]   2> 15531 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50673
[junit4:junit4]   2> 15532 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40007 with negotiated timeout 10000 for client /127.0.0.1:50673
[junit4:junit4]   2> 15533 T2076 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40007, negotiated timeout = 10000
[junit4:junit4]   2> 15533 T2077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55b6b9 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15533 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15533 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15535 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4:junit4]   2> 15538 T2073 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15538 T2077 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15539 T2071 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15539 T2065 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15538 T2075 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4]   2> 15539 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f8ab07
[junit4:junit4]   2> 15541 T2078 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15541 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15542 T2078 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15543 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50676
[junit4:junit4]   2> 15543 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50676
[junit4:junit4]   2> 15544 T2078 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40008, negotiated timeout = 10000
[junit4:junit4]   2> 15545 T2079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f8ab07 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15545 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40008 with negotiated timeout 10000 for client /127.0.0.1:50676
[junit4:junit4]   2> 15545 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15546 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15547 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4:junit4]   2> 15552 T2073 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 15553 T2077 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 15553 T2065 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 15553 T2079 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 15553 T2071 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 15553 T2075 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4]   2> 15553 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@85621
[junit4:junit4]   2> 15555 T2080 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15555 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15556 T2080 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15556 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50679
[junit4:junit4]   2> 15556 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50679
[junit4:junit4]   2> 15558 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40009 with negotiated timeout 10000 for client /127.0.0.1:50679
[junit4:junit4]   2> 15559 T2080 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40009, negotiated timeout = 10000
[junit4:junit4]   2> 15559 T2081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@85621 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15560 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15560 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15562 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4:junit4]   2> 15568 T2079 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 15569 T2065 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 15570 T2077 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 15570 T2075 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 15570 T2073 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 15570 T2071 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 15570 T2081 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4]   2> 15570 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@32c7a0
[junit4:junit4]   2> 15572 T2082 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15572 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15573 T2082 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15575 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50682
[junit4:junit4]   2> 15575 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50682
[junit4:junit4]   2> 15576 T2082 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc4000a, negotiated timeout = 10000
[junit4:junit4]   2> 15576 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc4000a with negotiated timeout 10000 for client /127.0.0.1:50682
[junit4:junit4]   2> 15577 T2083 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32c7a0 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15577 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15578 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15580 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4:junit4]   2> 15587 T2065 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15587 T2077 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15587 T2083 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15587 T2075 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15588 T2073 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15588 T2081 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15589 T2079 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15589 T2071 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4]   2> 15589 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1682dd7
[junit4:junit4]   2> 15590 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15590 T2084 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15591 T2084 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15591 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50685
[junit4:junit4]   2> 15591 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50685
[junit4:junit4]   2> 15593 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc4000b with negotiated timeout 10000 for client /127.0.0.1:50685
[junit4:junit4]   2> 15594 T2084 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc4000b, negotiated timeout = 10000
[junit4:junit4]   2> 15594 T2085 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1682dd7 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15594 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15595 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15596 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4:junit4]   2> 15599 T2085 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15599 T2079 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15601 T2065 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15601 T2077 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15601 T2083 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15601 T2073 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15601 T2081 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15601 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@66a778
[junit4:junit4]   2> 15601 T2071 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15601 T2075 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4]   2> 15602 T2086 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15603 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15603 T2086 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15604 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50688
[junit4:junit4]   2> 15604 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50688
[junit4:junit4]   2> 15605 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc4000c with negotiated timeout 10000 for client /127.0.0.1:50688
[junit4:junit4]   2> 15605 T2086 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc4000c, negotiated timeout = 10000
[junit4:junit4]   2> 15606 T2087 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66a778 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15606 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15607 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15608 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4:junit4]   2> 15612 T2087 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15612 T2085 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15612 T2079 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15612 T2065 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15612 T2077 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15613 T2071 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15614 T2083 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15614 T2075 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15614 T2081 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15614 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c13af0
[junit4:junit4]   2> 15614 T2073 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4]   2> 15615 T2088 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15615 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15616 T2088 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15616 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50691
[junit4:junit4]   2> 15617 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50691
[junit4:junit4]   2> 15618 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc4000d with negotiated timeout 10000 for client /127.0.0.1:50691
[junit4:junit4]   2> 15618 T2088 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc4000d, negotiated timeout = 10000
[junit4:junit4]   2> 15619 T2089 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c13af0 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15619 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15619 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15621 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4:junit4]   2> 15624 T2089 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15624 T2087 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15624 T2079 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15625 T2065 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15625 T2083 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15626 T2081 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15626 T2075 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15626 T2073 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15625 T2071 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15626 T2085 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15626 T2077 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4]   2> 15626 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@556d0c
[junit4:junit4]   2> 15628 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15628 T2090 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15630 T2090 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15630 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50694
[junit4:junit4]   2> 15630 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50694
[junit4:junit4]   2> 15631 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc4000e with negotiated timeout 10000 for client /127.0.0.1:50694
[junit4:junit4]   2> 15631 T2090 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc4000e, negotiated timeout = 10000
[junit4:junit4]   2> 15632 T2091 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@556d0c name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15632 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15633 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15634 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4:junit4]   2> 15638 T2085 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15638 T2087 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15639 T2089 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15639 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1541823
[junit4:junit4]   2> 15639 T2083 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15639 T2077 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15639 T2091 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15641 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15641 T2079 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15641 T2065 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15641 T2071 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15641 T2092 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15642 T2081 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15642 T2075 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15642 T2073 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4]   2> 15643 T2092 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15644 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50697
[junit4:junit4]   2> 15644 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50697
[junit4:junit4]   2> 15645 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc4000f with negotiated timeout 10000 for client /127.0.0.1:50697
[junit4:junit4]   2> 15645 T2092 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc4000f, negotiated timeout = 10000
[junit4:junit4]   2> 15646 T2093 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1541823 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15646 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15646 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15648 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4:junit4]   2> 15652 T2093 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15653 T2087 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15653 T2085 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15653 T2089 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15653 T2065 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15653 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1300348
[junit4:junit4]   2> 15655 T2077 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15655 T2083 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15653 T2079 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15655 T2081 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15655 T2075 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15655 T2071 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15655 T2073 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15655 T2091 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4]   2> 15655 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15655 T2094 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15658 T2094 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15658 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50700
[junit4:junit4]   2> 15658 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50700
[junit4:junit4]   2> 15659 T2094 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40010, negotiated timeout = 10000
[junit4:junit4]   2> 15660 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40010 with negotiated timeout 10000 for client /127.0.0.1:50700
[junit4:junit4]   2> 15660 T2095 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1300348 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15660 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15661 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15662 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
[junit4:junit4]   2> 15666 T2095 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15666 T2087 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15666 T2089 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15666 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1836736
[junit4:junit4]   2> 15666 T2085 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15666 T2079 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15666 T2093 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15667 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15667 T2065 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15667 T2077 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15668 T2073 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15667 T2075 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15667 T2083 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15668 T2096 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15668 T2091 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15668 T2071 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15668 T2081 oascc.ZkStateReader$3.process Updating live nodes... (13)
[junit4:junit4]   2> 15669 T2096 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15669 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50703
[junit4:junit4]   2> 15670 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50703
[junit4:junit4]   2> 15671 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40011 with negotiated timeout 10000 for client /127.0.0.1:50703
[junit4:junit4]   2> 15671 T2096 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40011, negotiated timeout = 10000
[junit4:junit4]   2> 15672 T2097 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1836736 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15673 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15673 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15675 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
[junit4:junit4]   2> 15680 T2087 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15680 T2077 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15680 T2065 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15681 T2079 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15681 T2083 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15681 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@e855e9
[junit4:junit4]   2> 15681 T2091 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15682 T2071 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15682 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15683 T2081 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15683 T2073 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15683 T2095 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15682 T2075 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15683 T2089 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15683 T2093 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15683 T2085 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15683 T2097 oascc.ZkStateReader$3.process Updating live nodes... (14)
[junit4:junit4]   2> 15683 T2098 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15685 T2098 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15685 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50706
[junit4:junit4]   2> 15685 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50706
[junit4:junit4]   2> 15687 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40012 with negotiated timeout 10000 for client /127.0.0.1:50706
[junit4:junit4]   2> 15687 T2098 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40012, negotiated timeout = 10000
[junit4:junit4]   2> 15687 T2099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e855e9 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15688 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15689 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15690 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
[junit4:junit4]   2> 15693 T2083 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15693 T2077 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15693 T2065 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15695 T2087 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15695 T2079 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15695 T2075 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15696 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@adf121
[junit4:junit4]   2> 15697 T2095 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15698 T2099 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15698 T2093 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15698 T2091 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15697 T2081 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15697 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15698 T2100 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15698 T2071 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15698 T2089 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15698 T2085 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15698 T2073 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15700 T2100 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15698 T2097 oascc.ZkStateReader$3.process Updating live nodes... (15)
[junit4:junit4]   2> 15700 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50709
[junit4:junit4]   2> 15700 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50709
[junit4:junit4]   2> 15701 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40013 with negotiated timeout 10000 for client /127.0.0.1:50709
[junit4:junit4]   2> 15702 T2100 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40013, negotiated timeout = 10000
[junit4:junit4]   2> 15702 T2101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@adf121 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15702 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15702 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15704 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
[junit4:junit4]   2> 15707 T2087 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15708 T2079 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15708 T2065 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15709 T2077 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15709 T2083 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15709 T2091 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15709 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@580706
[junit4:junit4]   2> 15711 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15711 T2099 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15711 T2071 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15711 T2089 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15712 T2095 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15711 T2075 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15712 T2102 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15711 T2081 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15712 T2073 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15712 T2097 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15712 T2093 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15713 T2102 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15712 T2101 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15711 T2085 oascc.ZkStateReader$3.process Updating live nodes... (16)
[junit4:junit4]   2> 15714 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50712
[junit4:junit4]   2> 15715 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50712
[junit4:junit4]   2> 15716 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40014 with negotiated timeout 10000 for client /127.0.0.1:50712
[junit4:junit4]   2> 15716 T2102 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40014, negotiated timeout = 10000
[junit4:junit4]   2> 15716 T2103 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@580706 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15717 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15718 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15719 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
[junit4:junit4]   2> 15723 T2079 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15723 T2087 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15724 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@9e88d3
[junit4:junit4]   2> 15725 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15723 T2065 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15725 T2095 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15726 T2103 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15726 T2093 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15726 T2081 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15726 T2091 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15727 T2083 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15727 T2077 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15726 T2075 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15727 T2104 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15726 T2099 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15726 T2071 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15726 T2089 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15727 T2073 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15728 T2101 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15727 T2097 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15728 T2085 oascc.ZkStateReader$3.process Updating live nodes... (17)
[junit4:junit4]   2> 15729 T2104 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15730 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50715
[junit4:junit4]   2> 15730 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50715
[junit4:junit4]   2> 15731 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40015 with negotiated timeout 10000 for client /127.0.0.1:50715
[junit4:junit4]   2> 15731 T2104 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40015, negotiated timeout = 10000
[junit4:junit4]   2> 15732 T2105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9e88d3 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15732 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15732 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15734 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
[junit4:junit4]   2> 15738 T2087 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15748 T2079 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15748 T2105 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15749 T2065 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15750 T2083 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15750 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1109d68
[junit4:junit4]   2> 15750 T2081 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2099 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2075 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2071 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2091 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2073 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2085 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2103 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2089 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15751 T2106 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15751 T2093 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2101 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2095 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2097 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15751 T2077 oascc.ZkStateReader$3.process Updating live nodes... (18)
[junit4:junit4]   2> 15753 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50718
[junit4:junit4]   2> 15753 T2106 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15754 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50718
[junit4:junit4]   2> 15755 T2106 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40016, negotiated timeout = 10000
[junit4:junit4]   2> 15756 T2107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1109d68 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   2> 15756 T1967 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4]   2> 15755 T2058 oazs.NIOServerCnxn.finishSessionInit Established session 0x13ab91c0cc40016 with negotiated timeout 10000 for client /127.0.0.1:50718
[junit4:junit4]   2> 15757 T1967 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
[junit4:junit4]   2> 15759 T1967 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
[junit4:junit4]   2> 15767 T2105 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15768 T1967 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:50649/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@11a4757
[junit4:junit4]   2> 15769 T2079 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T1967 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4]   2> 15770 T2095 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2073 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2085 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2089 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2093 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2075 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2065 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2103 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15770 T2099 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15771 T2101 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15771 T2091 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15771 T2087 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15771 T2071 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15771 T2083 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15771 T2081 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15772 T2077 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15772 T2107 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15772 T2097 oascc.ZkStateReader$3.process Updating live nodes... (19)
[junit4:junit4]   2> 15773 T2108 oaz.ClientCnxn$SendThread.startConnect Opening socket connection to server /127.0.0.1:50649
[junit4:junit4]   2> 15774 T2108 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to 127.0.0.1/127.0.0.1:50649, initiating session
[junit4:junit4]   2> 15774 T2056 oazs.NIOServerCnxn$Factory.run Accepted socket connection from /127.0.0.1:50721
[junit4:junit4]   2> 15774 T2056 oazs.NIOServerCnxn.readConnectRequest Client attempting to establish new session at /127.0.0.1:50721
[junit4:junit4]   2> 15776 T2108 oaz.ClientCnxn$SendThread.readConnectResult Session establishment complete on server 127.0.0.1/127.0.0.1:50649, sessionid = 0x13ab91c0cc40017, negotiated timeout = 10000
[junit4:junit4]   2> 15777 T2109 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11a4757 name:ZooKeeperConnection Watcher:127.0.0.1:50649/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4

[...truncated too long message...]

qpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4]   2> 129939 T2308 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 129939 T2302 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 130531 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   2> 130549 T2300 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91dcb6a0003 type:delete cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4]   2> 130550 T1967 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   2> 130558 T2300 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13ab91dcb6a0003 type:create cxid:0x25 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4]   2> 130561 T1967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
[junit4:junit4]   2> 130562 T2300 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91dcb6a0004
[junit4:junit4]   2> 130563 T2310 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 130563 T1967 oaz.ZooKeeper.close Session: 0x13ab91dcb6a0004 closed
[junit4:junit4]   2> 130563 T2297 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91dcb6a0004, likely client has closed socket
[junit4:junit4]   2> 130565 T2297 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50905 which had sessionid 0x13ab91dcb6a0004
[junit4:junit4]   2> 130567 T2302 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 130567 T2308 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (1)
[junit4:junit4]   2> 130567 T2300 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91dcb6a0003
[junit4:junit4]   2> 130568 T1967 oaz.ZooKeeper.close Session: 0x13ab91dcb6a0003 closed
[junit4:junit4]   2> 130568 T2297 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50902 which had sessionid 0x13ab91dcb6a0003
[junit4:junit4]   2> 130569 T2300 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13ab91dcb6a0000
[junit4:junit4]   2> 130569 T2302 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4]   2> 130571 T2302 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 130572 T2297 oazs.NIOServerCnxn.doIO WARNING EndOfStreamException: Unable to read additional data from client sessionid 0x13ab91dcb6a0000, likely client has closed socket
[junit4:junit4]   2> 130572 T2297 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:50893 which had sessionid 0x13ab91dcb6a0000
[junit4:junit4]   2> 130571 T1967 oaz.ZooKeeper.close Session: 0x13ab91dcb6a0000 closed
[junit4:junit4]   2> 130573 T2299 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4]   2> 130573 T2300 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4]   2> 130575 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 131103 T2311 oasc.Overseer$ClusterStateUpdater.amILeader WARNING  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:118)
[junit4:junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:42)
[junit4:junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:244)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63)
[junit4:junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:241)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:192)
[junit4:junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:116)
[junit4:junit4]   2> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> 
[junit4:junit4]   2> 131664 T2308 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 133040 T2297 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method
[junit4:junit4]   2> 131278 T2298 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4]   2> 133040 T2308 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4]   2> 133039 T2311 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88586680305057796-127.0.0.1:50890_solr-n_0000000000) am no longer a leader.
[junit4:junit4]   2> 133042 T1967 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4]   2> 133042 T2308 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4]   2> 133042 T1967 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4:junit4]   2> 133043 T1967 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4]   2> 133043 T1967 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4]   2> 136326 T1967 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=ga_IE, timezone=Indian/Comoro
[junit4:junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_07 (32-bit)/cpus=2,threads=10,free=65851680,total=274427904
[junit4:junit4]   2> NOTE: All tests run in this JVM: [SoftAutoCommitTest, AnalysisAfterCoreReloadTest, TestMultiCoreConfBootstrap, TestIndexingPerformance, FieldMutatingUpdateProcessorTest, TestCSVResponseWriter, WordBreakSolrSpellCheckerTest, TestDocSet, TestTrie, SpellingQueryConverterTest, TestHashPartitioner, RequestHandlersTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, LeaderElectionTest, ZkControllerTest, MoreLikeThisHandlerTest, TestIBSimilarityFactory, LukeRequestHandlerTest, SuggesterWFSTTest, CurrencyFieldTest, TestDocumentBuilder, BasicZkTest, SolrCoreCheckLockOnStartupTest, BadIndexSchemaTest, DirectUpdateHandlerOptimizeTest, SuggesterTest, TestStressRecovery, DirectSolrConnectionTest, TestReload, SolrCoreTest, TestSort, URLClassifyProcessorTest, TestLMJelinekMercerSimilarityFactory, OutputWriterTest, PolyFieldTest, SuggesterTSTTest, TestFoldingMultitermQuery, TestReplicationHandler, TestXIncludeConfig, SolrCmdDistributorTest, JsonLoaderTest, IndexSchemaTest, SimplePostToolTest, FieldAnalysisRequestHandlerTest, OpenExchangeRatesOrgProviderTest, ReturnFieldsTest, TestGroupingSearch, TestLuceneMatchVersion, AutoCommitTest, TestUpdate, TestOmitPositions, TestSolrDeletionPolicy1, BasicDistributedZk2Test, DocumentAnalysisRequestHandlerTest, SolrIndexConfigTest, MultiTermTest, DocumentBuilderTest, TestJmxIntegration, TestJoin, NoCacheHeaderTest, BadComponentTest, TestFastLRUCache, ZkCLITest, UpdateRequestProcessorFactoryTest, FastVectorHighlighterTest, TestPHPSerializedResponseWriter, JSONWriterTest, XmlUpdateRequestHandlerTest, QueryEqualityTest, TestFaceting, TestFiltering, TestExtendedDismaxParser, UpdateParamsTest, DateMathParserTest, TestRemoteStreaming, CSVRequestHandlerTest, TestNumberUtils, TestStressVersions, TestMergePolicyConfig, TestValueSourceCache, TestQuerySenderListener, TestAnalyzedSuggestions, SpatialFilterTest, BinaryUpdateRequestHandlerTest, TestDistributedSearch, LegacyHTMLStripCharFilterTest, DistributedQueryElevationComponentTest, TestSolr4Spatial, IndexSchemaRuntimeFieldTest, TestPropInject, TestCoreContainer, TermVectorComponentTest, MBeansHandlerTest, TestLFUCache, PrimUtilsTest, CacheHeaderTest, CopyFieldTest, TestPseudoReturnFields, SolrRequestParserTest, TestJmxMonitoredMap, SolrPluginUtilsTest, LoggingHandlerTest, TestBinaryField, SampleTest, SolrInfoMBeanTest, ScriptEngineTest, PeerSyncTest, ShowFileRequestHandlerTest, EchoParamsTest, CoreAdminHandlerTest, BasicDistributedZkTest, OverseerTest]
[junit4:junit4] Completed in 136.38s, 8 tests, 1 failure <<< FAILURES!

[...truncated 351 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:335: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:178: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\module-build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1163: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:827: There were test failures: 233 suites, 965 tests, 1 failure, 12 ignored (7 assumptions)

Total time: 41 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_07 -client -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message