lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-master-Windows (32bit/jdk1.8.0_144) - Build # 6824 - Still Unstable!
Date Tue, 15 Aug 2017 03:43:34 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/6824/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI

Error Message:
Something is broken in the assert for no shards using the same indexDir - probably something was changed in the attributes published in the MBean of SolrCore : {}

Stack Trace:
java.lang.AssertionError: Something is broken in the assert for no shards using the same indexDir - probably something was changed in the attributes published in the MBean of SolrCore : {}
	at __randomizedtesting.SeedInfo.seed([60CD8E0C8B9EC242:28B8FAB88DADEDD7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.checkNoTwoShardsUseTheSameIndexDir(CollectionsAPIDistributedZkTest.java:581)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:462)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11772 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\init-core-data-001
   [junit4]   2> 1232100 WARN  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 1232100 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1232104 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1232104 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1232106 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001
   [junit4]   2> 1232106 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1232107 INFO  (Thread-2268) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1232107 INFO  (Thread-2268) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1232111 ERROR (Thread-2268) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1232208 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:61343
   [junit4]   2> 1232216 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15de3caea690000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1232220 INFO  (jetty-launcher-1698-thread-2) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1232221 INFO  (jetty-launcher-1698-thread-1) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1232222 INFO  (jetty-launcher-1698-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@377b23{/solr,null,AVAILABLE}
   [junit4]   2> 1232222 INFO  (jetty-launcher-1698-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@290be8{SSL,[ssl, http/1.1]}{127.0.0.1:61347}
   [junit4]   2> 1232223 INFO  (jetty-launcher-1698-thread-2) [    ] o.e.j.s.Server Started @1240071ms
   [junit4]   2> 1232223 INFO  (jetty-launcher-1698-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=61347}
   [junit4]   2> 1232223 ERROR (jetty-launcher-1698-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1232223 INFO  (jetty-launcher-1698-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1232223 INFO  (jetty-launcher-1698-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1232223 INFO  (jetty-launcher-1698-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1232223 INFO  (jetty-launcher-1698-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-15T02:48:32.729Z
   [junit4]   2> 1232224 INFO  (jetty-launcher-1698-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e7e271{/solr,null,AVAILABLE}
   [junit4]   2> 1232225 INFO  (jetty-launcher-1698-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@184e489{SSL,[ssl, http/1.1]}{127.0.0.1:61352}
   [junit4]   2> 1232225 INFO  (jetty-launcher-1698-thread-1) [    ] o.e.j.s.Server Started @1240073ms
   [junit4]   2> 1232225 INFO  (jetty-launcher-1698-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=61352}
   [junit4]   2> 1232225 ERROR (jetty-launcher-1698-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1232225 INFO  (jetty-launcher-1698-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1232225 INFO  (jetty-launcher-1698-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1232225 INFO  (jetty-launcher-1698-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1232225 INFO  (jetty-launcher-1698-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-15T02:48:32.731Z
   [junit4]   2> 1232228 INFO  (jetty-launcher-1698-thread-3) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1232228 INFO  (jetty-launcher-1698-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17cf528{/solr,null,AVAILABLE}
   [junit4]   2> 1232229 INFO  (jetty-launcher-1698-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@85dacd{SSL,[ssl, http/1.1]}{127.0.0.1:61357}
   [junit4]   2> 1232229 INFO  (jetty-launcher-1698-thread-3) [    ] o.e.j.s.Server Started @1240077ms
   [junit4]   2> 1232229 INFO  (jetty-launcher-1698-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=61357}
   [junit4]   2> 1232229 ERROR (jetty-launcher-1698-thread-3) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1232229 INFO  (jetty-launcher-1698-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1232229 INFO  (jetty-launcher-1698-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1232229 INFO  (jetty-launcher-1698-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1232229 INFO  (jetty-launcher-1698-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-15T02:48:32.735Z
   [junit4]   2> 1232232 INFO  (jetty-launcher-1698-thread-4) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1232232 INFO  (jetty-launcher-1698-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1eb3cb6{/solr,null,AVAILABLE}
   [junit4]   2> 1232233 INFO  (jetty-launcher-1698-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@137536a{SSL,[ssl, http/1.1]}{127.0.0.1:61362}
   [junit4]   2> 1232233 INFO  (jetty-launcher-1698-thread-4) [    ] o.e.j.s.Server Started @1240081ms
   [junit4]   2> 1232233 INFO  (jetty-launcher-1698-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=61362}
   [junit4]   2> 1232233 ERROR (jetty-launcher-1698-thread-4) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1232233 INFO  (jetty-launcher-1698-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1232233 INFO  (jetty-launcher-1698-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1232233 INFO  (jetty-launcher-1698-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1232233 INFO  (jetty-launcher-1698-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-15T02:48:32.739Z
   [junit4]   2> 1232250 INFO  (jetty-launcher-1698-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1232257 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15de3caea690003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1232261 INFO  (jetty-launcher-1698-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61343/solr
   [junit4]   2> 1232263 INFO  (jetty-launcher-1698-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1232270 INFO  (jetty-launcher-1698-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61343/solr
   [junit4]   2> 1232273 INFO  (jetty-launcher-1698-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1232280 INFO  (jetty-launcher-1698-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61343/solr
   [junit4]   2> 1232282 INFO  (jetty-launcher-1698-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1232289 INFO  (jetty-launcher-1698-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:61343/solr
   [junit4]   2> 1232487 INFO  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1232487 INFO  (jetty-launcher-1698-thread-1) [n:127.0.0.1:61352_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1232487 INFO  (jetty-launcher-1698-thread-2) [n:127.0.0.1:61347_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1232487 INFO  (jetty-launcher-1698-thread-3) [n:127.0.0.1:61357_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1232488 INFO  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:61362_solr
   [junit4]   2> 1232489 INFO  (jetty-launcher-1698-thread-1) [n:127.0.0.1:61352_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61352_solr
   [junit4]   2> 1232489 INFO  (jetty-launcher-1698-thread-2) [n:127.0.0.1:61347_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61347_solr
   [junit4]   2> 1232489 INFO  (jetty-launcher-1698-thread-3) [n:127.0.0.1:61357_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61357_solr
   [junit4]   2> 1232490 INFO  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.c.Overseer Overseer (id=98485227527667724-127.0.0.1:61362_solr-n_0000000000) starting
   [junit4]   2> 1232491 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1232492 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1232492 INFO  (zkCallback-1716-thread-1-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1232593 INFO  (zkCallback-1720-thread-1-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 1232604 WARN  (jetty-launcher-1698-thread-1) [n:127.0.0.1:61352_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232604 WARN  (jetty-launcher-1698-thread-1) [n:127.0.0.1:61352_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232604 WARN  (jetty-launcher-1698-thread-1) [n:127.0.0.1:61352_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232605 INFO  (jetty-launcher-1698-thread-1) [n:127.0.0.1:61352_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node2
   [junit4]   2> 1232620 INFO  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61362_solr
   [junit4]   2> 1232621 WARN  (jetty-launcher-1698-thread-3) [n:127.0.0.1:61357_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232621 WARN  (jetty-launcher-1698-thread-3) [n:127.0.0.1:61357_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232621 WARN  (jetty-launcher-1698-thread-3) [n:127.0.0.1:61357_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232623 INFO  (jetty-launcher-1698-thread-3) [n:127.0.0.1:61357_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node3
   [junit4]   2> 1232623 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1232624 INFO  (zkCallback-1716-thread-1-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1232624 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1232624 INFO  (zkCallback-1720-thread-1-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 1232693 WARN  (jetty-launcher-1698-thread-2) [n:127.0.0.1:61347_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232693 WARN  (jetty-launcher-1698-thread-2) [n:127.0.0.1:61347_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232693 WARN  (jetty-launcher-1698-thread-2) [n:127.0.0.1:61347_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232694 INFO  (jetty-launcher-1698-thread-2) [n:127.0.0.1:61347_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node1
   [junit4]   2> 1232737 WARN  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232737 WARN  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232737 WARN  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1232737 INFO  (jetty-launcher-1698-thread-4) [n:127.0.0.1:61362_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node4
   [junit4]   2> 1232753 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1232754 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:61343/solr ready
   [junit4]   2> 1232780 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionOnlyInZk
   [junit4]   2> 1232781 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1232809 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=onlyinzk&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1232816 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=onlyinzk&action=DELETE&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 1232817 INFO  (qtp27335993-10971) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1232817 INFO  (qtp27335993-10971) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1232817 INFO  (qtp27335993-10970) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=onlyinzk&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1232820 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1232820 INFO  (OverseerThreadFactory-5021-thread-2-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.CreateCollectionCmd Create collection onlyinzk
   [junit4]   2> 1232927 INFO  (OverseerStateUpdate-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"onlyinzk",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"onlyinzk_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:61357/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1232929 INFO  (OverseerStateUpdate-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"onlyinzk",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"onlyinzk_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:61347/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1233137 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=onlyinzk_shard2_replica_n2&action=CREATE&numShards=2&collection=onlyinzk&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1233137 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1233158 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=onlyinzk_shard1_replica_n1&action=CREATE&numShards=2&collection=onlyinzk&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1233159 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1233264 INFO  (zkCallback-1716-thread-1-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1233264 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1233266 INFO  (zkCallback-1719-thread-2-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1233266 INFO  (zkCallback-1716-thread-2-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234160 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1234166 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.s.IndexSchema [onlyinzk_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 1234170 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1234170 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'onlyinzk_shard2_replica_n2' using configuration from collection onlyinzk, trusted=true
   [junit4]   2> 1234170 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1234172 WARN  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1234172 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1234172 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SolrCore [[onlyinzk_shard2_replica_n2] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node1\onlyinzk_shard2_replica_n2], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node1\onlyinzk_shard2_replica_n2\data\]
   [junit4]   2> 1234178 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.s.IndexSchema [onlyinzk_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1234180 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1234180 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'onlyinzk_shard1_replica_n1' using configuration from collection onlyinzk, trusted=true
   [junit4]   2> 1234180 WARN  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1234180 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1234180 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrCore [[onlyinzk_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node3\onlyinzk_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node3\onlyinzk_shard1_replica_n1\data\]
   [junit4]   2> 1234254 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1234254 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1234268 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1234268 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1234269 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1234269 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1234270 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1234270 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1234273 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3a0e94[onlyinzk_shard2_replica_n2] main]
   [junit4]   2> 1234274 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@c420cc[onlyinzk_shard1_replica_n1] main]
   [junit4]   2> 1234274 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1234274 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1234275 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1234275 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1234275 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1234275 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1234276 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575763642712850432
   [junit4]   2> 1234276 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575763642712850432
   [junit4]   2> 1234276 INFO  (searcherExecutor-5026-thread-1-processing-n:127.0.0.1:61357_solr x:onlyinzk_shard1_replica_n1 s:shard1 c:onlyinzk r:core_node3) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrCore [onlyinzk_shard1_replica_n1] Registered new searcher Searcher@c420cc[onlyinzk_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1234277 INFO  (searcherExecutor-5025-thread-1-processing-n:127.0.0.1:61347_solr x:onlyinzk_shard2_replica_n2 s:shard2 c:onlyinzk r:core_node4) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SolrCore [onlyinzk_shard2_replica_n2] Registered new searcher Searcher@3a0e94[onlyinzk_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1234283 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1234283 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1234283 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:61347/solr/onlyinzk_shard2_replica_n2/
   [junit4]   2> 1234283 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1234283 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.SyncStrategy https://127.0.0.1:61347/solr/onlyinzk_shard2_replica_n2/ has no replicas
   [junit4]   2> 1234283 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1234283 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1234283 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1234283 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:61357/solr/onlyinzk_shard1_replica_n1/
   [junit4]   2> 1234283 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1234283 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:61357/solr/onlyinzk_shard1_replica_n1/ has no replicas
   [junit4]   2> 1234283 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1234287 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:61357/solr/onlyinzk_shard1_replica_n1/ shard1
   [junit4]   2> 1234288 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:61347/solr/onlyinzk_shard2_replica_n2/ shard2
   [junit4]   2> 1234391 INFO  (zkCallback-1716-thread-2-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234391 INFO  (zkCallback-1719-thread-2-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234391 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234391 INFO  (zkCallback-1716-thread-1-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234440 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1234440 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1234442 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=onlyinzk_shard2_replica_n2&action=CREATE&numShards=2&collection=onlyinzk&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1306
   [junit4]   2> 1234447 INFO  (qtp14073861-10940) [n:127.0.0.1:61357_solr c:onlyinzk s:shard1 r:core_node3 x:onlyinzk_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=onlyinzk_shard1_replica_n1&action=CREATE&numShards=2&collection=onlyinzk&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1289
   [junit4]   2> 1234450 INFO  (qtp27335993-10970) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1234551 INFO  (zkCallback-1716-thread-1-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234551 INFO  (zkCallback-1716-thread-2-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234551 INFO  (zkCallback-1719-thread-2-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234551 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1234822 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1235450 INFO  (qtp27335993-10970) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=onlyinzk&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2632
   [junit4]   2> 1235450 INFO  (qtp27335993-10926) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1235451 INFO  (qtp27335993-10926) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1235451 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Ending deleteCollectionOnlyInZk
   [junit4]   2> 1235479 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionRemovesStaleZkCollectionsNode
   [junit4]   2> 1235480 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1235481 INFO  (qtp27335993-10925) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=onlyinzk&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1235484 INFO  (OverseerThreadFactory-5021-thread-3-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1235486 INFO  (qtp14073861-10939) [n:127.0.0.1:61357_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard1.replica_n1, tag=null
   [junit4]   2> 1235486 INFO  (qtp14073861-10939) [n:127.0.0.1:61357_solr    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12a093d: rootName = null, domain = solr.core.onlyinzk.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.onlyinzk.shard1.replica_n1 / null
   [junit4]   2> 1235486 INFO  (qtp14073861-10939) [n:127.0.0.1:61357_solr    ] o.a.s.c.SolrCore [onlyinzk_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1b3afe1
   [junit4]   2> 1235487 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard2.replica_n2, tag=null
   [junit4]   2> 1235487 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@db7b75: rootName = null, domain = solr.core.onlyinzk.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.onlyinzk.shard2.replica_n2 / null
   [junit4]   2> 1235487 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.c.SolrCore [onlyinzk_shard2_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@162798d
   [junit4]   2> 1235488 INFO  (qtp14073861-10939) [n:127.0.0.1:61357_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard1.replica_n1, tag=28553185
   [junit4]   2> 1235488 INFO  (qtp14073861-10939) [n:127.0.0.1:61357_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.onlyinzk.shard1.leader, tag=28553185
   [junit4]   2> 1235488 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard2.replica_n2, tag=23230861
   [junit4]   2> 1235488 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.onlyinzk.shard2.leader, tag=23230861
   [junit4]   2> 1235491 INFO  (qtp14073861-10939) [n:127.0.0.1:61357_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=onlyinzk_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 1235492 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=onlyinzk_shard2_replica_n2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 1236197 INFO  (qtp27335993-10925) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=onlyinzk&action=DELETE&wt=javabin&version=2} status=0 QTime=715
   [junit4]   2> 1236199 INFO  (qtp27335993-10971) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=out_of_sync_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1236200 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1236203 INFO  (qtp27335993-10971) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=out_of_sync_collection&action=DELETE&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 1236204 INFO  (qtp27335993-10972) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1236204 INFO  (qtp27335993-10972) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1236204 INFO  (TEST-CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Ending deleteCollectionRemovesStaleZkCollectionsNode
   [junit4]   2> 1236227 INFO  (TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testSpecificConfigsets
   [junit4]   2> 1236228 INFO  (TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1236229 INFO  (qtp27335993-10931) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf2&name=withconfigset2&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1236232 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1236232 INFO  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.CreateCollectionCmd Create collection withconfigset2
   [junit4]   2> 1236442 INFO  (OverseerStateUpdate-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"withconfigset2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"withconfigset2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:61352/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1236680 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf2&newCollection=true&name=withconfigset2_shard1_replica_n1&action=CREATE&numShards=1&collection=withconfigset2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1236681 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1236789 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/withconfigset2/state.json] for collection [withconfigset2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1236790 INFO  (zkCallback-1714-thread-2-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/withconfigset2/state.json] for collection [withconfigset2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1237700 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1237704 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.s.IndexSchema [withconfigset2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1237708 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1237708 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'withconfigset2_shard1_replica_n1' using configuration from collection withconfigset2, trusted=true
   [junit4]   2> 1237708 WARN  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1237708 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1237708 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.SolrCore [[withconfigset2_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node2\withconfigset2_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node2\withconfigset2_shard1_replica_n1\data\]
   [junit4]   2> 1237785 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1237785 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1237787 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1237787 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1237788 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@16fabd8[withconfigset2_shard1_replica_n1] main]
   [junit4]   2> 1237790 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf2
   [junit4]   2> 1237790 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf2
   [junit4]   2> 1237790 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1237790 INFO  (searcherExecutor-5035-thread-1-processing-n:127.0.0.1:61352_solr x:withconfigset2_shard1_replica_n1 s:shard1 c:withconfigset2 r:core_node2) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.SolrCore [withconfigset2_shard1_replica_n1] Registered new searcher Searcher@16fabd8[withconfigset2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1237791 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575763646398595072
   [junit4]   2> 1237795 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1237795 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1237795 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:61352/solr/withconfigset2_shard1_replica_n1/
   [junit4]   2> 1237795 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1237795 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:61352/solr/withconfigset2_shard1_replica_n1/ has no replicas
   [junit4]   2> 1237795 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1237798 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:61352/solr/withconfigset2_shard1_replica_n1/ shard1
   [junit4]   2> 1237903 INFO  (zkCallback-1714-thread-2-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/withconfigset2/state.json] for collection [withconfigset2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1237904 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/withconfigset2/state.json] for collection [withconfigset2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1237950 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1237951 INFO  (qtp13661702-10922) [n:127.0.0.1:61352_solr c:withconfigset2 s:shard1 r:core_node2 x:withconfigset2_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf2&newCollection=true&name=withconfigset2_shard1_replica_n1&action=CREATE&numShards=1&collection=withconfigset2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1271
   [junit4]   2> 1237953 INFO  (qtp27335993-10931) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1238055 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/withconfigset2/state.json] for collection [withconfigset2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1238055 INFO  (zkCallback-1714-thread-2-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/withconfigset2/state.json] for collection [withconfigset2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1238234 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1238955 INFO  (qtp27335993-10931) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf2&name=withconfigset2&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2726
   [junit4]   2> 1238956 INFO  (TEST-CollectionsAPIDistributedZkTest.testSpecificConfigsets-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSpecificConfigsets
   [junit4]   2> 1238980 INFO  (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testTooManyReplicas
   [junit4]   2> 1238981 INFO  (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1238983 INFO  (qtp27335993-10927) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=withconfigset2&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1238985 INFO  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1238987 INFO  (qtp13661702-10921) [n:127.0.0.1:61352_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.withconfigset2.shard1.replica_n1, tag=null
   [junit4]   2> 1238987 INFO  (qtp13661702-10921) [n:127.0.0.1:61352_solr    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1449d9c: rootName = null, domain = solr.core.withconfigset2.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.withconfigset2.shard1.replica_n1 / null
   [junit4]   2> 1238987 INFO  (qtp13661702-10921) [n:127.0.0.1:61352_solr    ] o.a.s.c.SolrCore [withconfigset2_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@11e3d41
   [junit4]   2> 1238988 INFO  (qtp13661702-10921) [n:127.0.0.1:61352_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.withconfigset2.shard1.replica_n1, tag=18758977
   [junit4]   2> 1238988 INFO  (qtp13661702-10921) [n:127.0.0.1:61352_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.withconfigset2.shard1.leader, tag=18758977
   [junit4]   2> 1238992 INFO  (qtp13661702-10921) [n:127.0.0.1:61352_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=withconfigset2_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 1239697 INFO  (qtp27335993-10927) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=withconfigset2&action=DELETE&wt=javabin&version=2} status=0 QTime=713
   [junit4]   2> 1239698 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=collection&nrtReplicas=10&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1239700 INFO  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.CreateCollectionCmd Create collection collection
   [junit4]   2> 1239700 WARN  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 10 on collection collection is higher than the number of Solr instances currently live or live and part of your createNodeSet(4). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   2> 1239700 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000010 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1239701 ERROR (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: collection operation: create failed:org.apache.solr.common.SolrException: Cannot create collection collection. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 4. This allows a maximum of 4 to be created. Value of numShards is 2, value of nrtReplicas is 10, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 20 shards to be created (higher than the allowed number)
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:157)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:227)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1239702 INFO  (qtp27335993-10928) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=collection&nrtReplicas=10&action=CREATE&numShards=2&wt=javabin&version=2} status=400 QTime=4
   [junit4]   2> 1239703 INFO  (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testTooManyReplicas
   [junit4]   2> 1239728 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreationAndDeletion
   [junit4]   2> 1239729 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1239731 INFO  (qtp27335993-10970) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=created_and_deleted&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1239732 INFO  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.CreateCollectionCmd Create collection created_and_deleted
   [junit4]   2> 1239733 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000012 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1239939 INFO  (OverseerStateUpdate-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"created_and_deleted",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"created_and_deleted_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:61352/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1240141 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=created_and_deleted_shard1_replica_n1&action=CREATE&numShards=1&collection=created_and_deleted&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1240248 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1240248 INFO  (zkCallback-1714-thread-2-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1241161 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1241165 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.s.IndexSchema [created_and_deleted_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1241168 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1241168 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'created_and_deleted_shard1_replica_n1' using configuration from collection created_and_deleted, trusted=true
   [junit4]   2> 1241170 WARN  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1241170 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1241170 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.SolrCore [[created_and_deleted_shard1_replica_n1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node2\created_and_deleted_shard1_replica_n1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001\tempDir-001\node2\created_and_deleted_shard1_replica_n1\data\]
   [junit4]   2> 1241230 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1241230 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1241231 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1241232 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1241232 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@14d8f94[created_and_deleted_shard1_replica_n1] main]
   [junit4]   2> 1241233 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 1241234 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 1241234 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1241234 INFO  (searcherExecutor-5040-thread-1-processing-n:127.0.0.1:61352_solr x:created_and_deleted_shard1_replica_n1 s:shard1 c:created_and_deleted r:core_node2) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.SolrCore [created_and_deleted_shard1_replica_n1] Registered new searcher Searcher@14d8f94[created_and_deleted_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1241234 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575763650008842240
   [junit4]   2> 1241239 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1241239 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1241239 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:61352/solr/created_and_deleted_shard1_replica_n1/
   [junit4]   2> 1241239 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1241239 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:61352/solr/created_and_deleted_shard1_replica_n1/ has no replicas
   [junit4]   2> 1241239 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1241242 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:61352/solr/created_and_deleted_shard1_replica_n1/ shard1
   [junit4]   2> 1241345 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1241345 INFO  (zkCallback-1714-thread-2-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1241395 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1241396 INFO  (qtp13661702-10920) [n:127.0.0.1:61352_solr c:created_and_deleted s:shard1 r:core_node2 x:created_and_deleted_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=created_and_deleted_shard1_replica_n1&action=CREATE&numShards=1&collection=created_and_deleted&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1255
   [junit4]   2> 1241398 INFO  (qtp27335993-10970) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1241499 INFO  (zkCallback-1714-thread-1-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1241499 INFO  (zkCallback-1714-thread-2-processing-n:127.0.0.1:61352_solr) [n:127.0.0.1:61352_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/created_and_deleted/state.json] for collection [created_and_deleted] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 1241734 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000014 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1242399 INFO  (qtp27335993-10970) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=created_and_deleted&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2668
   [junit4]   2> 1242400 INFO  (qtp27335993-10926) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1242400 INFO  (qtp27335993-10926) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1242401 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=created_and_deleted&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1242402 INFO  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 1242403 INFO  (qtp13661702-10919) [n:127.0.0.1:61352_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.created_and_deleted.shard1.replica_n1, tag=null
   [junit4]   2> 1242403 INFO  (qtp13661702-10919) [n:127.0.0.1:61352_solr    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@16d932: rootName = null, domain = solr.core.created_and_deleted.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.created_and_deleted.shard1.replica_n1 / null
   [junit4]   2> 1242404 INFO  (qtp13661702-10919) [n:127.0.0.1:61352_solr    ] o.a.s.c.SolrCore [created_and_deleted_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@196f6ff
   [junit4]   2> 1242405 INFO  (qtp13661702-10919) [n:127.0.0.1:61352_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.created_and_deleted.shard1.replica_n1, tag=26670847
   [junit4]   2> 1242405 INFO  (qtp13661702-10919) [n:127.0.0.1:61352_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.created_and_deleted.shard1.leader, tag=26670847
   [junit4]   2> 1242409 INFO  (qtp13661702-10919) [n:127.0.0.1:61352_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=created_and_deleted_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 1243113 INFO  (qtp27335993-10924) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=created_and_deleted&action=DELETE&wt=javabin&version=2} status=0 QTime=712
   [junit4]   2> 1243114 INFO  (qtp27335993-10925) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1243114 INFO  (qtp27335993-10925) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1243115 INFO  (TEST-CollectionsAPIDistributedZkTest.testCreationAndDeletion-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCreationAndDeletion
   [junit4]   2> 1243137 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testZeroNumShards
   [junit4]   2> 1243138 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1243140 INFO  (qtp27335993-10971) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1243141 INFO  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.CreateCollectionCmd Create collection acollection
   [junit4]   2> 1243142 ERROR (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: acollection operation: create failed:org.apache.solr.common.SolrException: numShards must be > 0
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:127)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:227)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1243142 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000016 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1243144 INFO  (qtp27335993-10971) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=acollection&action=CREATE&numShards=0&wt=javabin&version=2} status=400 QTime=4
   [junit4]   2> 1243144 INFO  (TEST-CollectionsAPIDistributedZkTest.testZeroNumShards-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testZeroNumShards
   [junit4]   2> 1243168 INFO  (TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMaxNodesPerShard
   [junit4]   2> 1243169 INFO  (TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1243170 INFO  (qtp27335993-10972) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=oversharded&nrtReplicas=2&action=CREATE&numShards=3&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1243172 INFO  (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.CreateCollectionCmd Create collection oversharded
   [junit4]   2> 1243172 ERROR (OverseerThreadFactory-5021-thread-5-processing-n:127.0.0.1:61362_solr) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerCollectionMessageHandler Collection: oversharded operation: create failed:org.apache.solr.common.SolrException: Cannot create collection oversharded. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 4. This allows a maximum of 4 to be created. Value of numShards is 3, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 6 shards to be created (higher than the allowed number)
   [junit4]   2> 	at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:157)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:227)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1243173 INFO  (OverseerCollectionConfigSetProcessor-98485227527667724-127.0.0.1:61362_solr-n_0000000000) [n:127.0.0.1:61362_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000018 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1243175 INFO  (qtp27335993-10972) [n:127.0.0.1:61347_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=oversharded&nrtReplicas=2&action=CREATE&numShards=3&wt=javabin&version=2} status=400 QTime=4
   [junit4]   2> 1243175 INFO  (TEST-CollectionsAPIDistributedZkTest.testMaxNodesPerShard-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testMaxNodesPerShard
   [junit4]   2> 1243202 INFO  (TEST-CollectionsAPIDistributedZkTest.testMissingRequiredParameters-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMissingRequiredParameters
   [junit4]   2> 1243203 INFO  (TEST-CollectionsAPIDistributedZkTest.testMissingRequiredParameters-seed#[60CD8E0C8B9EC242]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 1243205 INFO  (qtp27335993-10931) [n:127.0.0.1:61347_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params action=CREATE&numShards=2&wt=javabin&version=2 and sendToO

[...truncated too long message...]

vletHandler$CachedChain.doFilter(ServletHandler.java:1699)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:462)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:202)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 1349825 INFO  (qtp16524918-11228) [n:127.0.0.1:61362_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:61347_solr&onlyIfLeaderActive=true&core=addReplicaColl_shard1_replica_n2&coreNodeName=core_node13&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=400 QTime=2007
   [junit4]   2> 1350520 WARN  (zkCallback-1719-thread-12-processing-n:127.0.0.1:61357_solr) [n:127.0.0.1:61357_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1350520 INFO  (jetty-closer-1699-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@17cf528{/solr,null,UNAVAILABLE}
   [junit4]   2> 1350540 WARN  (zkCallback-1716-thread-8-processing-n:127.0.0.1:61347_solr) [n:127.0.0.1:61347_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1350540 INFO  (jetty-closer-1699-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@377b23{/solr,null,UNAVAILABLE}
   [junit4]   2> 1350542 ERROR (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1350543 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[60CD8E0C8B9EC242]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:61343 61343
   [junit4]   2> 1350544 INFO  (Thread-2327) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:61343 61343
   [junit4]   2> 1350545 WARN  (Thread-2327) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	15	/solr/configs/conf
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	61	/solr/collections/addReplicaColl/state.json
   [junit4]   2> 	24	/solr/collections/nodes_used_collection/state.json
   [junit4]   2> 	15	/solr/collections/acollectionafterbaddelete/state.json
   [junit4]   2> 	13	/solr/collections/halfdeletedcollection/state.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/collections/halfcollectionblocker2/state.json
   [junit4]   2> 	4	/solr/collections/halfcollectionblocker/state.json
   [junit4]   2> 	4	/solr/collections/awhollynewcollection_0/state.json
   [junit4]   2> 	4	/solr/collections/halfcollection/state.json
   [junit4]   2> 	2	/solr/collections/addReplicaColl/leader_elect/shard1/election/98485227527667729-core_node5-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	285	/solr/collections
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.CollectionsAPIDistributedZkTest_60CD8E0C8B9EC242-001
   [junit4]   2> Aug 15, 2017 2:50:31 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=FST50}, docValues:{}, maxPointsInLeafNode=1098, maxMBSortInHeap=7.126697798037536, sim=RandomSimilarity(queryNorm=true): {}, locale=es-US, timezone=SST
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_144 (32-bit)/cpus=3,threads=1,free=101440928,total=457179136
   [junit4]   2> NOTE: All tests run in this JVM: [CacheHeaderTest, TestWordDelimiterFilterFactory, DistribCursorPagingTest, CloudMLTQParserTest, DocValuesMultiTest, TestIndexSearcher, SolrCoreMetricManagerTest, BasicAuthIntegrationTest, TestScoreJoinQPScore, TestBulkSchemaAPI, RankQueryTest, StatsReloadRaceTest, TestNamedUpdateProcessors, SearchHandlerTest, AddBlockUpdateTest, HdfsUnloadDistributedZkTest, TestSimpleTrackingShardHandler, ForceLeaderTest, DistributedMLTComponentTest, TestFastLRUCache, TestExclusionRuleCollectionAccess, ClassificationUpdateProcessorFactoryTest, TestNumericRangeQuery32, RulesTest, TestJettySolrRunner, SolrGangliaReporterTest, TestNumericTokenStream, TestXmlQParserPlugin, UninvertDocValuesMergePolicyTest, TestPointFields, TestRecovery, TestPKIAuthenticationPlugin, DistribJoinFromCollectionTest, JvmMetricsTest, TestPivotHelperCode, CdcrBootstrapTest, TestMissingGroups, TestDocSet, TestHalfAndHalfDocValues, GraphQueryTest, TestSolrXml, SolrPluginUtilsTest, QueryEqualityTest, FieldMutatingUpdateProcessorTest, TestAnalyzedSuggestions, TestNonDefinedSimilarityFactory, TestSolrCoreSnapshots, TestCloudRecovery, DocumentBuilderTest, TestManagedResourceStorage, OpenExchangeRatesOrgProviderTest, TestMacros, CoreMergeIndexesAdminHandlerTest, TestFastOutputStream, TestManagedSynonymGraphFilterFactory, TestZkChroot, DebugComponentTest, FacetPivotSmallTest, TestRestoreCore, TestClassicSimilarityFactory, AssignBackwardCompatibilityTest, HdfsRecoverLeaseTest, NodeMutatorTest, CopyFieldTest, FileBasedSpellCheckerTest, TestPullReplica, DocExpirationUpdateProcessorFactoryTest, TestReplicationHandlerBackup, TestSolrDeletionPolicy1, PKIAuthenticationIntegrationTest, TestStreamBody, ZkStateReaderTest, TestSolrCloudWithSecureImpersonation, TestLockTree, UpdateRequestProcessorFactoryTest, SparseHLLTest, LeaderFailoverAfterPartitionTest, HdfsLockFactoryTest, TestSerializedLuceneMatchVersion, ParsingFieldUpdateProcessorsTest, HdfsChaosMonkeyNothingIsSafeTest, ChaosMonkeySafeLeaderTest, SolrIndexConfigTest, TestLegacyFieldReuse, SolrSlf4jReporterTest, SolrCoreCheckLockOnStartupTest, SmileWriterTest, CollectionsAPISolrJTest, HttpPartitionTest, TestCustomSort, TestLuceneMatchVersion, ExternalFileFieldSortTest, LukeRequestHandlerTest, CollectionReloadTest, DeleteShardTest, SampleTest, StatelessScriptUpdateProcessorFactoryTest, OpenCloseCoreStressTest, TestHashQParserPlugin, TestConfigSetsAPIExclusivity, BJQParserTest, LargeFieldTest, TestLRUCache, HdfsThreadLeakTest, ReplicaListTransformerTest, TestSolr4Spatial, TestGeoJSONResponseWriter, CollectionTooManyReplicasTest, TestLegacyFieldCache, SignatureUpdateProcessorFactoryTest, TestDistributedMissingSort, TestDistribDocBasedVersion, TestElisionMultitermQuery, TestCoreDiscovery, TestCoreAdminApis, PreAnalyzedFieldTest, TestCrossCoreJoin, TestClusterProperties, TriLevelCompositeIdRoutingTest, SaslZkACLProviderTest, TestReloadAndDeleteDocs, TestLeaderInitiatedRecoveryThread, DistributedExpandComponentTest, BooleanFieldTest, TestRealTimeGet, TestSimpleTextCodec, MoveReplicaTest, OverseerStatusTest, SuggesterFSTTest, TestSolrCloudWithDelegationTokens, LoggingHandlerTest, PluginInfoTest, TestRawResponseWriter, AutoCommitTest, TestSolrConfigHandlerConcurrent, TestBM25SimilarityFactory, TestFieldCache, TestRTimerTree, TestCustomStream, SolrJmxReporterCloudTest, SuggesterTSTTest, TestExactStatsCache, TestBackupRepositoryFactory, TestManagedSchemaAPI, AnalyticsQueryTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [333/730 (1!)] on J1 in 119.47s, 19 tests, 1 failure <<< FAILURES!

[...truncated 40717 lines...]

Mime
View raw message