lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20304 - Still Unstable!
Date Sat, 12 Aug 2017 13:52:42 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20304/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.LeaderElectionContextKeyTest.test

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([342C0DDEA7A1500F:BC783204095D3DF7]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.cloud.LeaderElectionContextKeyTest.test(LeaderElectionContextKeyTest.java:88)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.TestAuthenticationFramework.testBasics

Error Message:
Error from server at https://127.0.0.1:46325/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason: <pre>    Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:46325/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([342C0DDEA7A1500F:9F4A3F29F4F0E7F]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
	at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:46325/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more




Build Log:
[...truncated 12064 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderElectionContextKeyTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/init-core-data-001
   [junit4]   2> 1931331 WARN  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=38 numCloses=38
   [junit4]   2> 1931331 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1931334 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1931346 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1931347 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001
   [junit4]   2> 1931347 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1931359 INFO  (Thread-3143) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1931359 INFO  (Thread-3143) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1931391 ERROR (Thread-3143) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1931461 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:33481
   [junit4]   2> 1931479 INFO  (jetty-launcher-2571-thread-1) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1931511 INFO  (jetty-launcher-2571-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3b469709{/solr,null,AVAILABLE}
   [junit4]   2> 1931512 INFO  (jetty-launcher-2571-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@242a8ee9{SSL,[ssl, http/1.1]}{127.0.0.1:34023}
   [junit4]   2> 1931512 INFO  (jetty-launcher-2571-thread-1) [    ] o.e.j.s.Server Started @1932859ms
   [junit4]   2> 1931512 INFO  (jetty-launcher-2571-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34023}
   [junit4]   2> 1931512 ERROR (jetty-launcher-2571-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1931514 INFO  (jetty-launcher-2571-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 1931515 INFO  (jetty-launcher-2571-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1931515 INFO  (jetty-launcher-2571-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1931515 INFO  (jetty-launcher-2571-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-12T13:24:07.813Z
   [junit4]   2> 1931523 INFO  (jetty-launcher-2571-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1931542 INFO  (jetty-launcher-2571-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33481/solr
   [junit4]   2> 1931625 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1931626 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34023_solr
   [junit4]   2> 1931632 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.c.Overseer Overseer (id=98470739814645763-127.0.0.1:34023_solr-n_0000000000) starting
   [junit4]   2> 1931678 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34023_solr
   [junit4]   2> 1931690 INFO  (zkCallback-2578-thread-1-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1931812 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34023.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@19dcde3a
   [junit4]   2> 1931816 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34023.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@19dcde3a
   [junit4]   2> 1931816 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34023.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@19dcde3a
   [junit4]   2> 1931817 INFO  (jetty-launcher-2571-thread-1) [n:127.0.0.1:34023_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/.
   [junit4]   2> 1931883 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1931890 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33481/solr ready
   [junit4]   2> 1931940 INFO  (qtp1537764895-14964) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=config&maxShardsPerNode=1000&name=testCollection1&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1931956 INFO  (OverseerThreadFactory-7641-thread-1-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.CreateCollectionCmd Create collection testCollection1
   [junit4]   2> 1932072 INFO  (OverseerStateUpdate-98470739814645763-127.0.0.1:34023_solr-n_0000000000) [n:127.0.0.1:34023_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testCollection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testCollection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34023/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1932073 INFO  (OverseerStateUpdate-98470739814645763-127.0.0.1:34023_solr-n_0000000000) [n:127.0.0.1:34023_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testCollection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testCollection1_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34023/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1932290 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testCollection1_shard2_replica_n2&action=CREATE&numShards=2&collection=testCollection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1932290 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1932295 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testCollection1_shard1_replica_n1&action=CREATE&numShards=2&collection=testCollection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1932404 INFO  (zkCallback-2578-thread-1-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1933301 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1933304 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.s.IndexSchema [testCollection1_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1933306 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1933306 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testCollection1_shard1_replica_n1' using configuration from collection testCollection1, trusted=true
   [junit4]   2> 1933306 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34023.solr.core.testCollection1.shard1.replica_n1' (registry 'solr.core.testCollection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@19dcde3a
   [junit4]   2> 1933306 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1933306 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SolrCore [[testCollection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/testCollection1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/./testCollection1_shard1_replica_n1/data/]
   [junit4]   2> 1933307 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1933312 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.s.IndexSchema [testCollection1_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 1933314 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1933314 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testCollection1_shard2_replica_n2' using configuration from collection testCollection1, trusted=true
   [junit4]   2> 1933314 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34023.solr.core.testCollection1.shard2.replica_n2' (registry 'solr.core.testCollection1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@19dcde3a
   [junit4]   2> 1933314 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1933314 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.SolrCore [[testCollection1_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/testCollection1_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/./testCollection1_shard2_replica_n2/data/]
   [junit4]   2> 1933334 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1933334 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1933352 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1933352 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1933353 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@20fc2f8d[testCollection1_shard1_replica_n1] main]
   [junit4]   2> 1933354 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1933355 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1933355 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1933356 INFO  (searcherExecutor-7644-thread-1-processing-n:127.0.0.1:34023_solr x:testCollection1_shard1_replica_n1 s:shard1 c:testCollection1 r:core_node3) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SolrCore [testCollection1_shard1_replica_n1] Registered new searcher Searcher@20fc2f8d[testCollection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1933356 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575531839125192704
   [junit4]   2> 1933360 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1933361 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1933361 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34023/solr/testCollection1_shard1_replica_n1/
   [junit4]   2> 1933361 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1933361 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:34023/solr/testCollection1_shard1_replica_n1/ has no replicas
   [junit4]   2> 1933361 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1933363 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34023/solr/testCollection1_shard1_replica_n1/ shard1
   [junit4]   2> 1933363 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1933363 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1933364 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1933364 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1933364 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@4fb055d3[testCollection1_shard2_replica_n2] main]
   [junit4]   2> 1933365 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1933365 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1933366 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1933366 INFO  (searcherExecutor-7645-thread-1-processing-n:127.0.0.1:34023_solr x:testCollection1_shard2_replica_n2 s:shard2 c:testCollection1 r:core_node4) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.SolrCore [testCollection1_shard2_replica_n2] Registered new searcher Searcher@4fb055d3[testCollection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1933366 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575531839135678464
   [junit4]   2> 1933369 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1933369 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1933369 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34023/solr/testCollection1_shard2_replica_n2/
   [junit4]   2> 1933369 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1933369 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.SyncStrategy https://127.0.0.1:34023/solr/testCollection1_shard2_replica_n2/ has no replicas
   [junit4]   2> 1933369 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1933370 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34023/solr/testCollection1_shard2_replica_n2/ shard2
   [junit4]   2> 1933471 INFO  (zkCallback-2578-thread-1-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1933514 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1933515 INFO  (qtp1537764895-14955) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=testCollection1_shard1_replica_n1&action=CREATE&numShards=2&collection=testCollection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1220
   [junit4]   2> 1933520 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1933521 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr c:testCollection1 s:shard2 r:core_node4 x:testCollection1_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testCollection1_shard2_replica_n2&action=CREATE&numShards=2&collection=testCollection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1231
   [junit4]   2> 1933522 INFO  (qtp1537764895-14964) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1933622 INFO  (zkCallback-2578-thread-2-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection1/state.json] for collection [testCollection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1933957 INFO  (OverseerCollectionConfigSetProcessor-98470739814645763-127.0.0.1:34023_solr-n_0000000000) [n:127.0.0.1:34023_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1934526 INFO  (qtp1537764895-14964) [n:127.0.0.1:34023_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=config&maxShardsPerNode=1000&name=testCollection1&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2586
   [junit4]   2> 1934534 INFO  (qtp1537764895-14953) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=config&maxShardsPerNode=1000&name=testCollection2&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1934549 INFO  (OverseerThreadFactory-7641-thread-2-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.CreateCollectionCmd Create collection testCollection2
   [junit4]   2> 1934669 INFO  (OverseerStateUpdate-98470739814645763-127.0.0.1:34023_solr-n_0000000000) [n:127.0.0.1:34023_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testCollection2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testCollection2_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34023/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1934672 INFO  (OverseerStateUpdate-98470739814645763-127.0.0.1:34023_solr-n_0000000000) [n:127.0.0.1:34023_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testCollection2",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testCollection2_shard2_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:34023/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1934873 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=config&newCollection=true&name=testCollection2_shard1_replica_n1&action=CREATE&numShards=2&collection=testCollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1934873 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testCollection2_shard2_replica_n3&action=CREATE&numShards=2&collection=testCollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1934978 INFO  (zkCallback-2578-thread-2-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1934978 INFO  (zkCallback-2578-thread-1-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1935883 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1935883 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1935889 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.s.IndexSchema [testCollection2_shard2_replica_n3] Schema name=minimal
   [junit4]   2> 1935889 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.s.IndexSchema [testCollection2_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1935891 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1935891 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testCollection2_shard1_replica_n1' using configuration from collection testCollection2, trusted=true
   [junit4]   2> 1935892 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34023.solr.core.testCollection2.shard1.replica_n1' (registry 'solr.core.testCollection2.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@19dcde3a
   [junit4]   2> 1935892 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1935892 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SolrCore [[testCollection2_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/testCollection2_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/./testCollection2_shard1_replica_n1/data/]
   [junit4]   2> 1935891 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1935895 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'testCollection2_shard2_replica_n3' using configuration from collection testCollection2, trusted=true
   [junit4]   2> 1935895 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34023.solr.core.testCollection2.shard2.replica_n3' (registry 'solr.core.testCollection2.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@19dcde3a
   [junit4]   2> 1935895 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1935895 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SolrCore [[testCollection2_shard2_replica_n3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/testCollection2_shard2_replica_n3], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001/tempDir-001/node1/./testCollection2_shard2_replica_n3/data/]
   [junit4]   2> 1935943 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1935944 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1935945 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1935945 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1935946 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@49b31f3a[testCollection2_shard1_replica_n1] main]
   [junit4]   2> 1935947 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1935947 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1935948 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1935948 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575531841843101696
   [junit4]   2> 1935948 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1935949 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1935950 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1935950 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1935951 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@3770e693[testCollection2_shard2_replica_n3] main]
   [junit4]   2> 1935952 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1935952 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1935953 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1935953 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575531841848344576
   [junit4]   2> 1935953 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1935953 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1935954 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34023/solr/testCollection2_shard1_replica_n1/
   [junit4]   2> 1935954 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1935954 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:34023/solr/testCollection2_shard1_replica_n1/ has no replicas
   [junit4]   2> 1935954 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1935955 INFO  (searcherExecutor-7655-thread-1-processing-n:127.0.0.1:34023_solr x:testCollection2_shard2_replica_n3 s:shard2 c:testCollection2 r:core_node4) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SolrCore [testCollection2_shard2_replica_n3] Registered new searcher Searcher@3770e693[testCollection2_shard2_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1935956 INFO  (searcherExecutor-7654-thread-1-processing-n:127.0.0.1:34023_solr x:testCollection2_shard1_replica_n1 s:shard1 c:testCollection2 r:core_node2) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SolrCore [testCollection2_shard1_replica_n1] Registered new searcher Searcher@49b31f3a[testCollection2_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1935956 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1935956 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1935956 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34023/solr/testCollection2_shard2_replica_n3/
   [junit4]   2> 1935957 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1935957 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SyncStrategy https://127.0.0.1:34023/solr/testCollection2_shard2_replica_n3/ has no replicas
   [junit4]   2> 1935957 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1935958 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34023/solr/testCollection2_shard1_replica_n1/ shard1
   [junit4]   2> 1935960 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34023/solr/testCollection2_shard2_replica_n3/ shard2
   [junit4]   2> 1936060 INFO  (zkCallback-2578-thread-3-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1936061 INFO  (zkCallback-2578-thread-2-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1936062 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1936070 INFO  (qtp1537764895-14960) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=config&newCollection=true&name=testCollection2_shard1_replica_n1&action=CREATE&numShards=2&collection=testCollection2&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1197
   [junit4]   2> 1936111 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1936111 INFO  (qtp1537764895-14954) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=testCollection2_shard2_replica_n3&action=CREATE&numShards=2&collection=testCollection2&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1238
   [junit4]   2> 1936117 INFO  (qtp1537764895-14953) [n:127.0.0.1:34023_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1936213 INFO  (zkCallback-2578-thread-3-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1936213 INFO  (zkCallback-2578-thread-2-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testCollection2/state.json] for collection [testCollection2] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1936551 INFO  (OverseerCollectionConfigSetProcessor-98470739814645763-127.0.0.1:34023_solr-n_0000000000) [n:127.0.0.1:34023_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1937123 INFO  (qtp1537764895-14953) [n:127.0.0.1:34023_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=config&maxShardsPerNode=1000&name=testCollection2&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=2588
   [junit4]   2> 1937124 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: testCollection1 failOnTimeout:true timeout (sec):30
   [junit4]   2> 1937124 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: testCollection1
   [junit4]   2> 1937124 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: testCollection2 failOnTimeout:true timeout (sec):30
   [junit4]   2> 1937124 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: testCollection2
   [junit4]   2> 1937137 INFO  (TEST-LeaderElectionContextKeyTest.test-seed#[342C0DDEA7A1500F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 1937142 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection1.shard2.replica_n2, tag=null
   [junit4]   2> 1937146 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr    ] o.a.s.c.SolrCore [testCollection1_shard2_replica_n2]  CLOSING SolrCore org.apache.solr.core.SolrCore@7d456fd3
   [junit4]   2> 1937157 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection1.shard2.replica_n2, tag=2101702611
   [junit4]   2> 1937157 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection1.shard2.leader, tag=2101702611
   [junit4]   2> 1937158 INFO  (qtp1537764895-14956) [n:127.0.0.1:34023_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=false&core=testCollection1_shard2_replica_n2&deleteDataDir=false&action=UNLOAD&indexInfo=true&wt=javabin&version=2&deleteIndex=false} status=0 QTime=16
   [junit4]   2> 1937159 INFO  (TEST-LeaderElectionContextKeyTest.test-seed#[342C0DDEA7A1500F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending test
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=LeaderElectionContextKeyTest -Dtests.method=test -Dtests.seed=342C0DDEA7A1500F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=VST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.04s J2 | LeaderElectionContextKeyTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([342C0DDEA7A1500F:BC783204095D3DF7]:0)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElectionContextKeyTest.test(LeaderElectionContextKeyTest.java:88)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1937162 INFO  (jetty-closer-2572-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@242a8ee9{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1937163 INFO  (jetty-closer-2572-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1834468871
   [junit4]   2> 1937166 INFO  (jetty-closer-2572-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1937168 INFO  (jetty-closer-2572-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1937169 INFO  (jetty-closer-2572-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1937171 INFO  (jetty-closer-2572-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1937182 INFO  (coreCloseExecutor-7664-thread-1) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.c.SolrCore [testCollection1_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@11844c4b
   [junit4]   2> 1937182 INFO  (coreCloseExecutor-7664-thread-3) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.c.SolrCore [testCollection2_shard2_replica_n3]  CLOSING SolrCore org.apache.solr.core.SolrCore@4f8a86a7
   [junit4]   2> 1937182 INFO  (coreCloseExecutor-7664-thread-2) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.c.SolrCore [testCollection2_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7fde484e
   [junit4]   2> 1937182 INFO  (coreCloseExecutor-7664-thread-1) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection1.shard1.replica_n1, tag=293882955
   [junit4]   2> 1937186 INFO  (coreCloseExecutor-7664-thread-1) [n:127.0.0.1:34023_solr c:testCollection1 s:shard1 r:core_node3 x:testCollection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection1.shard1.leader, tag=293882955
   [junit4]   2> 1937186 INFO  (coreCloseExecutor-7664-thread-3) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection2.shard2.replica_n3, tag=1334478503
   [junit4]   2> 1937189 INFO  (coreCloseExecutor-7664-thread-3) [n:127.0.0.1:34023_solr c:testCollection2 s:shard2 r:core_node4 x:testCollection2_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection2.shard2.leader, tag=1334478503
   [junit4]   2> 1937190 INFO  (coreCloseExecutor-7664-thread-2) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testCollection2.shard1.replica_n1, tag=2145273934
   [junit4]   2> 1937193 INFO  (coreCloseExecutor-7664-thread-2) [n:127.0.0.1:34023_solr c:testCollection2 s:shard1 r:core_node2 x:testCollection2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testCollection2.shard1.leader, tag=2145273934
   [junit4]   2> 1937193 INFO  (jetty-closer-2572-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98470739814645763-127.0.0.1:34023_solr-n_0000000000) closing
   [junit4]   2> 1937193 INFO  (OverseerStateUpdate-98470739814645763-127.0.0.1:34023_solr-n_0000000000) [n:127.0.0.1:34023_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34023_solr
   [junit4]   2> 1938700 WARN  (zkCallback-2578-thread-2-processing-n:127.0.0.1:34023_solr) [n:127.0.0.1:34023_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1938700 INFO  (jetty-closer-2572-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3b469709{/solr,null,UNAVAILABLE}
   [junit4]   2> 1938700 ERROR (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1938701 INFO  (SUITE-LeaderElectionContextKeyTest-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33481 33481
   [junit4]   2> 1938982 INFO  (Thread-3143) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33481 33481
   [junit4]   2> 1938982 WARN  (Thread-3143) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/collections/testCollection2/state.json
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.LeaderElectionContextKeyTest_342C0DDEA7A1500F-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=786, maxMBSortInHeap=7.859325910886356, sim=RandomSimilarity(queryNorm=false): {}, locale=sr, timezone=VST
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=99061024,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [CoreMergeIndexesAdminHandlerTest, BigEndianAscendingWordDeserializerTest, V2StandaloneTest, TestExceedMaxTermLength, TimeZoneUtilsTest, TestInPlaceUpdatesStandalone, TestStressReorder, TestFieldCacheWithThreads, SharedFSAutoReplicaFailoverTest, ConfigureRecoveryStrategyTest, UUIDUpdateProcessorFallbackTest, DistributedExpandComponentTest, RegexBoostProcessorTest, TestConfigSetsAPIExclusivity, TestJettySolrRunner, TestCloudSchemaless, TestNonDefinedSimilarityFactory, TestSolrCloudWithSecureImpersonation, ExplicitHLLTest, ShowFileRequestHandlerTest, WrapperMergePolicyFactoryTest, PolyFieldTest, CloneFieldUpdateProcessorFactoryTest, SolrCoreCheckLockOnStartupTest, TestSubQueryTransformer, TestBackupRepositoryFactory, TestSort, XsltUpdateRequestHandlerTest, TestUnifiedSolrHighlighter, TestTrie, CollectionsAPIAsyncDistributedZkTest, TestSearcherReuse, TestManagedSchema, NotRequiredUniqueKeyTest, QueryEqualityTest, TestQueryWrapperFilter, TestPKIAuthenticationPlugin, SolrTestCaseJ4Test, TestObjectReleaseTracker, HdfsSyncSliceTest, TestRecovery, PathHierarchyTokenizerFactoryTest, SortByFunctionTest, TestJsonFacets, AnalysisErrorHandlingTest, CdcrReplicationDistributedZkTest, AddSchemaFieldsUpdateProcessorFactoryTest, MergeStrategyTest, TestUseDocValuesAsStored, MinimalSchemaTest, SignatureUpdateProcessorFactoryTest, TestManagedSynonymFilterFactory, TestConfigSetProperties, HdfsUnloadDistributedZkTest, TestCollectionAPI, TestOverriddenPrefixQueryForCustomFieldType, HLLUtilTest, TestExportWriter, SuggesterTest, BasicAuthStandaloneTest, PeerSyncWithIndexFingerprintCachingTest, DateRangeFieldTest, DeleteStatusTest, FullSolrCloudDistribCmdsTest, BufferStoreTest, StatsComponentTest, SuggesterFSTTest, TestPseudoReturnFields, HdfsRecoverLeaseTest, CopyFieldTest, DistributedFacetPivotLongTailTest, TestLegacyFieldReuse, TestMacroExpander, TestTolerantSearch, TestZkAclsWithHadoopAuth, DocumentBuilderTest, SolrCLIZkUtilsTest, TestManagedResource, TestRandomFlRTGCloud, SearchHandlerTest, PreAnalyzedFieldTest, TestReload, TestSolr4Spatial2, TestFieldCacheSort, TestSurroundQueryParser, TestSolrConfigHandlerConcurrent, ManagedSchemaRoundRobinCloudTest, TemplateUpdateProcessorTest, TestExclusionRuleCollectionAccess, TermVectorComponentDistributedTest, UniqFieldsUpdateProcessorFactoryTest, TestGroupingSearch, TestPrepRecovery, TestReplicaProperties, URLClassifyProcessorTest, ClassificationUpdateProcessorFactoryTest, BadIndexSchemaTest, NodeMutatorTest, TestSolrConfigHandler, PrimitiveFieldTypeTest, TestDefaultStatsCache, ReplicationFactorTest, BlockJoinFacetRandomTest, TestAddFieldRealTimeGet, TestReRankQParserPlugin, TestReloadAndDeleteDocs, CustomCollectionTest, TestFastWriter, DistributedSuggestComponentTest, SolrMetricReporterTest, PropertiesRequestHandlerTest, HdfsBasicDistributedZk2Test, SimpleMLTQParserTest, TestScoreJoinQPScore, TestXmlQParser, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, ZkCLITest, ShardRoutingCustomTest, AutoCommitTest, TestFaceting, ZkControllerTest, TestJoin, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, SpellCheckComponentTest, BasicFunctionalityTest, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, SoftAutoCommitTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, CoreAdminHandlerTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, TestStressLucene, SpatialFilterTest, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, DirectUpdateHandlerOptimizeTest, DocValuesMultiTest, SolrInfoBeanTest, DebugComponentTest, LukeRequestHandlerTest, TestQueryUtils, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, TestValueSourceCache, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, TestSolrQueryParser, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, IndexSchemaTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest, MBeansHandlerTest, TestAnalyzedSuggestions, JsonLoaderTest, BinaryUpdateRequestHandlerTest, PingRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, TestLFUCache, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, ResponseLogComponentTest, TestStressRecovery, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, TestBinaryField, NumericFieldsTest, TestElisionMultitermQuery, OutputWriterTest, TestSolrCoreProperties, DirectSolrConnectionTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCodecSupport, EchoParamsTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, ResourceLoaderTest, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, TestCrossCoreJoin, TestDistributedMissingSort, AliasIntegrationTest, AssignTest, BaseCdcrDistributedZkTest, CdcrVersionReplicationTest, CollectionReloadTest, CollectionTooManyReplicasTest, ConfigSetsAPITest, ConnectionManagerTest, DeleteNodeTest, DeleteShardTest, DistribJoinFromCollectionTest, DocValuesNotIndexedTest, LeaderElectionContextKeyTest]
   [junit4] Completed [424/729 (1!)] on J2 in 7.67s, 1 test, 1 failure <<< FAILURES!

[...truncated 208 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestAuthenticationFramework
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_342C0DDEA7A1500F-001/init-core-data-001
   [junit4]   2> 2161163 INFO  (SUITE-TestAuthenticationFramework-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2161164 INFO  (SUITE-TestAuthenticationFramework-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2161165 INFO  (SUITE-TestAuthenticationFramework-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2161166 INFO  (TEST-TestAuthenticationFramework.testBasics-seed#[342C0DDEA7A1500F]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_342C0DDEA7A1500F-001/tempDir-001
   [junit4]   2> 2161166 INFO  (TEST-TestAuthenticationFramework.testBasics-seed#[342C0DDEA7A1500F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2161167 INFO  (Thread-5172) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2161167 INFO  (Thread-5172) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2161168 ERROR (Thread-5172) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2161267 INFO  (TEST-TestAuthenticationFramework.testBasics-seed#[342C0DDEA7A1500F]) [    ] o.a.s.c.ZkTestServer start zk server on port:46097
   [junit4]   2> 2161275 INFO  (jetty-launcher-2554-thread-1) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2161276 INFO  (jetty-launcher-2554-thread-2) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 2161276 INFO  (jetty-launcher-2554-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@52241f0e{/solr,null,AVAILABLE}
   [junit4]   2> 2161277 INFO  (jetty-launcher-2554-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64cc02b4{/solr,null,AVAILABLE}
   [junit4]   2> 2161283 INFO  (jetty-launcher-2554-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7711da27{SSL,[ssl, http/1.1]}{127.0.0.1:42525}
   [junit4]   2> 2161283 INFO  (jetty-launcher-2554-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6eea82a6{SSL,[ssl, http/1.1]}{127.0.0.1:46325}
   [junit4]   2> 2161283 INFO  (jetty-launcher-2554-thread-2) [    ] o.e.j.s.Server Started @2162696ms
   [junit4]   2> 2161283 INFO  (jetty-launcher-2554-thread-1) [    ] o.e.j.s.Server Started @2162696ms
   [junit4]   2> 2161283 INFO  (jetty-launcher-2554-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42525}
   [junit4]   2> 2161283 INFO  (jetty-launcher-2554-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46325}
   [junit4]   2> 2161283 ERROR (jetty-launcher-2554-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2161283 ERROR (jetty-launcher-2554-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-12T13:27:57.654Z
   [junit4]   2> 2161284 INFO  (jetty-launcher-2554-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-12T13:27:57.654Z
   [junit4]   2> 2161294 INFO  (jetty-launcher-2554-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2161298 INFO  (jetty-launcher-2554-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2161332 INFO  (jetty-launcher-2554-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46097/solr
   [junit4]   2> 2161332 INFO  (jetty-launcher-2554-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46097/solr
   [junit4]   2> 2161382 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2161382 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42525_solr
   [junit4]   2> 2161382 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.c.Overseer Overseer (id=98470754879864837-127.0.0.1:42525_solr-n_0000000000) starting
   [junit4]   2> 2161393 INFO  (jetty-launcher-2554-thread-1) [n:127.0.0.1:46325_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2161393 INFO  (jetty-launcher-2554-thread-1) [n:127.0.0.1:46325_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46325_solr
   [junit4]   2> 2161399 INFO  (OverseerStateUpdate-98470754879864837-127.0.0.1:42525_solr-n_0000000000) [n:127.0.0.1:42525_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2161400 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42525_solr
   [junit4]   2> 2161400 INFO  (zkCallback-2565-thread-1-processing-n:127.0.0.1:42525_solr) [n:127.0.0.1:42525_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2161418 INFO  (zkCallback-2566-thread-1-processing-n:127.0.0.1:46325_solr) [n:127.0.0.1:46325_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2161457 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
   [junit4]   2> 2161475 INFO  (jetty-launcher-2554-thread-1) [n:127.0.0.1:46325_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
   [junit4]   2> 2161490 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42525.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2161491 INFO  (jetty-launcher-2554-thread-1) [n:127.0.0.1:46325_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46325.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2161494 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42525.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2161494 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42525.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2161495 INFO  (jetty-launcher-2554-thread-1) [n:127.0.0.1:46325_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46325.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2161495 INFO  (jetty-launcher-2554-thread-1) [n:127.0.0.1:46325_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46325.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2161495 INFO  (jetty-launcher-2554-thread-2) [n:127.0.0.1:42525_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_342C0DDEA7A1500F-001/tempDir-001/node1/.
   [junit4]   2> 2161496 INFO  (jetty-launcher-2554-thread-1) [n:127.0.0.1:46325_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_342C0DDEA7A1500F-001/tempDir-001/node2/.
   [junit4]   2> 2161538 INFO  (TEST-TestAuthenticationFramework.testBasics-seed#[342C0DDEA7A1500F]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2161539 INFO  (TEST-TestAuthenticationFramework.testBasics-seed#[342C0DDEA7A1500F]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46097/solr ready
   [junit4]   2> 2161540 INFO  (TEST-TestAuthenticationFramework.testBasics-seed#[342C0DDEA7A1500F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBasics
   [junit4]   2> 2161570 INFO  (qtp642381104-18247) [n:127.0.0.1:46325_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=2&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2161572 INFO  (OverseerThreadFactory-5980-thread-1-processing-n:127.0.0.1:42525_solr) [n:127.0.0.1:42525_solr    ] o.a.s.c.CreateCollectionCmd Create collection testcollection
   [junit4]   2> 2161680 INFO  (OverseerStateUpdate-98470754879864837-127.0.0.1:42525_solr-n_0000000000) [n:127.0.0.1:42525_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testcollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42525/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2161681 INFO  (OverseerStateUpdate-98470754879864837-127.0.0.1:42525_solr-n_0000000000) [n:127.0.0.1:42525_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testcollection_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:46325/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2161683 INFO  (OverseerStateUpdate-98470754879864837-127.0.0.1:42525_solr-n_0000000000) [n:127.0.0.1:42525_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testcollection_shard2_replica_n5",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:42525/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2161685 INFO  (OverseerStateUpdate-98470754879864837-127.0.0.1:42525_solr-n_0000000000) [n:127.0.0.1:42525_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testcollection_shard2_replica_n7",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:46325/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2161921 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=solrCloudCollectionConfig&newCollection=true&name=testcollection_shard2_replica_n7&action=CREATE&numShards=2&collection=testcollection&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2161921 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2161921 INFO  (qtp642381104-18249) [n:127.0.0.1:46325_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=solrCloudCollectionConfig&newCollection=true&name=testcollection_shard1_replica_n3&action=CREATE&numShards=2&collection=testcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2161949 INFO  (qtp810765476-18256) [n:127.0.0.1:42525_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=solrCloudCollectionConfig&newCollection=true&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&collection=testcollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2161950 INFO  (qtp810765476-18256) [n:127.0.0.1:42525_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2161961 INFO  (qtp810765476-18263) [n:127.0.0.1:42525_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=solrCloudCollectionConfig&newCollection=true&name=testcollection_shard2_replica_n5&action=CREATE&numShards=2&collection=testcollection&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2162087 INFO  (zkCallback-2565-thread-1-processing-n:127.0.0.1:42525_solr) [n:127.0.0.1:42525_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2162087 INFO  (zkCallback-2565-thread-2-processing-n:127.0.0.1:42525_solr) [n:127.0.0.1:42525_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2162087 INFO  (zkCallback-2566-thread-1-processing-n:127.0.0.1:46325_solr) [n:127.0.0.1:46325_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2162942 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2162943 INFO  (qtp642381104-18249) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2162963 INFO  (qtp642381104-18249) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.s.IndexSchema [testcollection_shard1_replica_n3] Schema name=minimal
   [junit4]   2> 2162963 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.s.IndexSchema [testcollection_shard2_replica_n7] Schema name=minimal
   [junit4]   2> 2162965 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2162965 INFO  (qtp642381104-18249) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2162965 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n7' using configuration from collection testcollection, trusted=true
   [junit4]   2> 2162965 INFO  (qtp642381104-18249) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n3' using configuration from collection testcollection, trusted=true
   [junit4]   2> 2162965 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46325.solr.core.testcollection.shard2.replica_n7' (registry 'solr.core.testcollection.shard2.replica_n7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2162965 INFO  (qtp642381104-18249) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46325.solr.core.testcollection.shard1.replica_n3' (registry 'solr.core.testcollection.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@24f4d499
   [junit4]   2> 2162966 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2162966 INFO  (qtp642381104-18249) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2162966 INFO  (qtp642381104-18254) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SolrCore [[testcollection_shard2_replica_n7] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_342C0DDEA7A1500F-001/tempDi

[...truncated too long message...]

[junit4]   2> 2169527 INFO  (coreCloseExecutor-6025-thread-2) [n:127.0.0.1:42525_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.c.SolrCore [testcollection_shard2_replica_n6]  CLOSING SolrCore org.apache.solr.core.SolrCore@3fc6289b
   [junit4]   2> 2169527 INFO  (coreCloseExecutor-6026-thread-1) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [testcollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7c797c2f
   [junit4]   2> 2169527 INFO  (coreCloseExecutor-6025-thread-1) [n:127.0.0.1:42525_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard1.replica_n2, tag=416889613
   [junit4]   2> 2169527 INFO  (coreCloseExecutor-6026-thread-1) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard1.replica_n1, tag=2088336431
   [junit4]   2> 2169530 INFO  (coreCloseExecutor-6025-thread-2) [n:127.0.0.1:42525_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard2.replica_n6, tag=1069951131
   [junit4]   2> 2169527 INFO  (coreCloseExecutor-6026-thread-2) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n5] o.a.s.c.SolrCore [testcollection_shard2_replica_n5]  CLOSING SolrCore org.apache.solr.core.SolrCore@793616e2
   [junit4]   2> 2169531 INFO  (coreCloseExecutor-6026-thread-2) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard2.replica_n5, tag=2033587938
   [junit4]   2> 2169533 INFO  (coreCloseExecutor-6025-thread-1) [n:127.0.0.1:42525_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=416889613
   [junit4]   2> 2169533 INFO  (coreCloseExecutor-6025-thread-2) [n:127.0.0.1:42525_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard2.leader, tag=1069951131
   [junit4]   2> 2169534 INFO  (jetty-closer-2555-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98470754879864837-127.0.0.1:42525_solr-n_0000000000) closing
   [junit4]   2> 2169534 INFO  (OverseerStateUpdate-98470754879864837-127.0.0.1:42525_solr-n_0000000000) [n:127.0.0.1:42525_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:42525_solr
   [junit4]   2> 2169535 INFO  (coreCloseExecutor-6026-thread-1) [n:127.0.0.1:46325_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=2088336431
   [junit4]   2> 2169535 INFO  (coreCloseExecutor-6026-thread-2) [n:127.0.0.1:46325_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard2.leader, tag=2033587938
   [junit4]   2> 2169543 INFO  (jetty-closer-2555-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@64cc02b4{/solr,null,UNAVAILABLE}
   [junit4]   2> 2169543 INFO  (zkCallback-2566-thread-1-processing-n:127.0.0.1:46325_solr) [n:127.0.0.1:46325_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46325_solr
   [junit4]   2> 2169543 INFO  (zkCallback-2566-thread-2-processing-n:127.0.0.1:46325_solr) [n:127.0.0.1:46325_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 2169551 INFO  (jetty-closer-2555-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@52241f0e{/solr,null,UNAVAILABLE}
   [junit4]   2> 2169552 ERROR (SUITE-TestAuthenticationFramework-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2169553 INFO  (SUITE-TestAuthenticationFramework-seed#[342C0DDEA7A1500F]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46097 46097
   [junit4]   2> 2174575 INFO  (Thread-5172) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46097 46097
   [junit4]   2> 2174579 WARN  (Thread-5172) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/configs/solrCloudCollectionConfig
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	24	/solr/collections/testcollection/state.json
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestAuthenticationFramework_342C0DDEA7A1500F-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=Memory)}, docValues:{}, maxPointsInLeafNode=1630, maxMBSortInHeap=7.545556508856839, sim=RandomSimilarity(queryNorm=false): {}, locale=es-CL, timezone=Africa/Banjul
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=98108408,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [MetricUtilsTest, TestDownShardTolerantSearch, TolerantUpdateProcessorTest, TestSweetSpotSimilarityFactory, SolrCmdDistributorTest, SchemaVersionSpecificBehaviorTest, GraphQueryTest, ShardSplitTest, StatelessScriptUpdateProcessorFactoryTest, ClusterStateUpdateTest, ReplaceNodeTest, SOLR749Test, DirectoryFactoryTest, NoCacheHeaderTest, TestSmileRequest, SortSpecParsingTest, TestCursorMarkWithoutUniqueKey, TestFastLRUCache, TestOrdValues, CacheHeaderTest, TestSha256AuthenticationProvider, TestDocBasedVersionConstraints, TestCharFilters, HdfsRestartWhileUpdatingTest, TestMaxTokenLenTokenizer, DirectSolrSpellCheckerTest, TestSolrIndexConfig, CdcrRequestHandlerTest, TestSearchPerf, SolrMetricManagerTest, TestGraphMLResponseWriter, TestSolrConfigHandlerCloud, TestBM25SimilarityFactory, UpdateRequestProcessorFactoryTest, TestSolrCloudSnapshots, TestDistributedGrouping, TestCloudInspectUtil, TestJsonFacetRefinement, TestFuzzyAnalyzedSuggestions, TestDFISimilarityFactory, DisMaxRequestHandlerTest, TestRequestStatusCollectionAPI, QueryParsingTest, TestPostingsSolrHighlighter, TestSchemalessBufferedUpdates, DistanceFunctionTest, CloudExitableDirectoryReaderTest, TestSchemaNameResource, HdfsLockFactoryTest, ActionThrottleTest, TestFiltering, DistributedVersionInfoTest, TestLeaderElectionWithEmptyReplica, ResponseHeaderTest, TestPivotHelperCode, BadComponentTest, TestCustomDocTransformer, StressHdfsTest, SolrSlf4jReporterTest, TestCoreContainer, FileUtilsTest, DistributedMLTComponentTest, BitVectorTest, BlockDirectoryTest, CloudMLTQParserTest, DistribDocExpirationUpdateProcessorTest, TestHashQParserPlugin, TestManagedSchemaThreadSafety, TestStressVersions, TestNoOpRegenerator, TestSystemIdResolver, AtomicUpdatesTest, TestHashPartitioner, TestFreeTextSuggestions, TestConfigSetsAPI, HLLSerializationTest, JSONWriterTest, SolrGangliaReporterTest, HdfsNNFailoverTest, MetricsHandlerTest, SegmentsInfoRequestHandlerTest, SampleTest, LeaderFailoverAfterPartitionTest, TestExactSharedStatsCache, HighlighterTest, ConvertedLegacyTest, DataDrivenBlockJoinTest, TestAuthorizationFramework, ScriptEngineTest, SolrXmlInZkTest, TestFieldSortValues, TestFieldCacheReopen, TestDynamicFieldCollectionResource, BasicAuthIntegrationTest, ZkSolrClientTest, TestInPlaceUpdatesDistrib, TestRebalanceLeaders, HighlighterMaxOffsetTest, OverriddenZkACLAndCredentialsProvidersTest, TestSolrCLIRunExample, ConcurrentDeleteAndCreateCollectionTest, ChaosMonkeySafeLeaderTest, TestStreamBody, TestEmbeddedSolrServerSchemaAPI, TestRTGBase, HealthCheckHandlerTest, RulesTest, TestCryptoKeys, TestOnReconnectListenerSupport, LoggingHandlerTest, DeleteLastCustomShardedReplicaTest, PeerSyncReplicationTest, TestLegacyField, TestPartialUpdateDeduplication, TestStressInPlaceUpdates, ChaosMonkeySafeLeaderWithPullReplicasTest, TestHdfsBackupRestoreCore, DistributedQueryComponentOptimizationTest, TestXIncludeConfig, ClassificationUpdateProcessorTest, PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, CircularListTest, CursorPagingTest, DistributedIntervalFacetingTest, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, AssignBackwardCompatibilityTest, AsyncCallRequestStatusResponseTest, CdcrBootstrapTest, CreateCollectionCleanupTest, DistribCursorPagingTest, HttpPartitionTest, MissingSegmentRecoveryTest, MoveReplicaHDFSUlogDirTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerRolesTest, OverseerStatusTest, RestartWhileUpdatingTest, RollingRestartTest, SSLMigrationTest, SaslZkACLProviderTest, TestAuthenticationFramework]
   [junit4] Completed [487/729 (2!)] on J1 in 13.43s, 1 test, 1 error <<< FAILURES!

[...truncated 44161 lines...]

Mime
View raw message