lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 114 - Still Unstable!
Date Tue, 15 Aug 2017 00:19:46 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/114/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingSorting

Error Message:
Should have exactly 4 documents returned expected:<4> but was:<3>

Stack Trace:
java.lang.AssertionError: Should have exactly 4 documents returned expected:<4> but was:<3>
	at __randomizedtesting.SeedInfo.seed([A948C8AD1BAE0C9A:B770C0A56705B61A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.DocValuesNotIndexedTest.checkSortOrder(DocValuesNotIndexedTest.java:260)
	at org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingSorting(DocValuesNotIndexedTest.java:245)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11234 lines...]
   [junit4] Suite: org.apache.solr.cloud.DocValuesNotIndexedTest
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/init-core-data-001
   [junit4]   2> 1077360 WARN  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 1077360 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1077364 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
   [junit4]   2> 1077364 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1077365 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001
   [junit4]   2> 1077365 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1077366 INFO  (Thread-1006) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1077366 INFO  (Thread-1006) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1077368 ERROR (Thread-1006) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1077470 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:51563
   [junit4]   2> 1077496 INFO  (jetty-launcher-835-thread-1) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1077496 INFO  (jetty-launcher-835-thread-2) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 1077498 INFO  (jetty-launcher-835-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@43f8d834{/solr,null,AVAILABLE}
   [junit4]   2> 1077498 INFO  (jetty-launcher-835-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@71a6fef5{/solr,null,AVAILABLE}
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5e8357b7{SSL,[ssl, http/1.1]}{127.0.0.1:51565}
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-2) [    ] o.e.j.s.Server Started @1081273ms
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@461d87f3{SSL,[ssl, http/1.1]}{127.0.0.1:51566}
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51565}
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-1) [    ] o.e.j.s.Server Started @1081273ms
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51566}
   [junit4]   2> 1077499 ERROR (jetty-launcher-835-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1077499 ERROR (jetty-launcher-835-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.1.0
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.1.0
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-14T23:24:00.754Z
   [junit4]   2> 1077499 INFO  (jetty-launcher-835-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-14T23:24:00.754Z
   [junit4]   2> 1077501 INFO  (jetty-launcher-835-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1077502 INFO  (jetty-launcher-835-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1077511 INFO  (jetty-launcher-835-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51563/solr
   [junit4]   2> 1077511 INFO  (jetty-launcher-835-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51563/solr
   [junit4]   2> 1077632 INFO  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1077633 INFO  (jetty-launcher-835-thread-2) [n:127.0.0.1:51565_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1077634 INFO  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51566_solr
   [junit4]   2> 1077634 INFO  (jetty-launcher-835-thread-2) [n:127.0.0.1:51565_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51565_solr
   [junit4]   2> 1077635 INFO  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.c.Overseer Overseer (id=98484423270268933-127.0.0.1:51566_solr-n_0000000000) starting
   [junit4]   2> 1077636 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1077636 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1077648 INFO  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51566_solr
   [junit4]   2> 1077650 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1077650 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1077717 WARN  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1077717 WARN  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1077717 WARN  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1077717 WARN  (jetty-launcher-835-thread-2) [n:127.0.0.1:51565_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1077718 INFO  (jetty-launcher-835-thread-1) [n:127.0.0.1:51566_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node1/.
   [junit4]   2> 1077718 WARN  (jetty-launcher-835-thread-2) [n:127.0.0.1:51565_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1077718 WARN  (jetty-launcher-835-thread-2) [n:127.0.0.1:51565_solr    ] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1077718 INFO  (jetty-launcher-835-thread-2) [n:127.0.0.1:51565_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/.
   [junit4]   2> 1077736 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1077737 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:51563/solr ready
   [junit4]   2> 1077757 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&maxShardsPerNode=2&name=dv_coll&nrtReplicas=1&action=CREATE&numShards=4&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1077760 INFO  (OverseerThreadFactory-1993-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.CreateCollectionCmd Create collection dv_coll
   [junit4]   2> 1077876 INFO  (OverseerStateUpdate-98484423270268933-127.0.0.1:51566_solr-n_0000000000) [n:127.0.0.1:51566_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"dv_coll_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:51565/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1077880 INFO  (OverseerStateUpdate-98484423270268933-127.0.0.1:51566_solr-n_0000000000) [n:127.0.0.1:51566_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"dv_coll_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:51566/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1077882 INFO  (OverseerStateUpdate-98484423270268933-127.0.0.1:51566_solr-n_0000000000) [n:127.0.0.1:51566_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard3",
   [junit4]   2>   "core":"dv_coll_shard3_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:51565/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1077889 INFO  (OverseerStateUpdate-98484423270268933-127.0.0.1:51566_solr-n_0000000000) [n:127.0.0.1:51566_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"dv_coll",
   [junit4]   2>   "shard":"shard4",
   [junit4]   2>   "core":"dv_coll_shard4_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:51566/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 1078102 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=dv_coll_shard1_replica_n1&action=CREATE&numShards=4&collection=dv_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1078102 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=dv_coll_shard3_replica_n4&action=CREATE&numShards=4&collection=dv_coll&shard=shard3&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1078102 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1078121 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=dv_coll_shard2_replica_n2&action=CREATE&numShards=4&collection=dv_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1078123 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1078124 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=dv_coll_shard4_replica_n6&action=CREATE&numShards=4&collection=dv_coll&shard=shard4&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1078233 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1078233 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1078233 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1078234 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079134 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
   [junit4]   2> 1079135 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
   [junit4]   2> 1079142 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.IndexSchema [dv_coll_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1079142 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema [dv_coll_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 1079145 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1079145 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard1_replica_n1' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1079145 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1079145 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard3_replica_n4' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1079150 WARN  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1079150 WARN  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1079151 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1079151 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1079151 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore [[dv_coll_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/dv_coll_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/./dv_coll_shard1_replica_n1/data/]
   [junit4]   2> 1079151 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [[dv_coll_shard3_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/dv_coll_shard3_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/./dv_coll_shard3_replica_n4/data/]
   [junit4]   2> 1079160 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
   [junit4]   2> 1079161 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
   [junit4]   2> 1079177 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.IndexSchema [dv_coll_shard4_replica_n6] Schema name=minimal
   [junit4]   2> 1079178 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1079178 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard4_replica_n6' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1079179 WARN  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1079179 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1079179 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrCore [[dv_coll_shard4_replica_n6] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node1/dv_coll_shard4_replica_n6], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node1/./dv_coll_shard4_replica_n6/data/]
   [junit4]   2> 1079179 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.IndexSchema [dv_coll_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 1079181 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1079181 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'dv_coll_shard2_replica_n2' using configuration from collection dv_coll, trusted=true
   [junit4]   2> 1079182 WARN  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1079182 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1079182 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore [[dv_coll_shard2_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node1/dv_coll_shard2_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node1/./dv_coll_shard2_replica_n2/data/]
   [junit4]   2> 1079246 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1079247 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1079248 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1079248 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1079249 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1079249 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1079251 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1079251 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1079252 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1079252 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1079253 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1079253 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1079253 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1079253 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1079255 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@2e3f1da[dv_coll_shard3_replica_n4] main]
   [junit4]   2> 1079255 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@43f3781f[dv_coll_shard2_replica_n2] main]
   [junit4]   2> 1079255 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1079255 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1079255 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4e6b927c[dv_coll_shard1_replica_n1] main]
   [junit4]   2> 1079256 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d598fc9[dv_coll_shard4_replica_n6] main]
   [junit4]   2> 1079256 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1079257 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1079257 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1079257 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1079257 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1079257 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1079258 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1079258 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1079258 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1079258 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1079258 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1079259 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1079259 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575750774307160064
   [junit4]   2> 1079259 INFO  (searcherExecutor-1999-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard3_replica_n4 s:shard3 c:dv_coll r:core_node7) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4] Registered new searcher Searcher@2e3f1da[dv_coll_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1079259 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1079260 INFO  (searcherExecutor-2001-thread-1-processing-n:127.0.0.1:51566_solr x:dv_coll_shard2_replica_n2 s:shard2 c:dv_coll r:core_node5) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore [dv_coll_shard2_replica_n2] Registered new searcher Searcher@43f3781f[dv_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1079260 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575750774308208640
   [junit4]   2> 1079261 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1079261 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1079263 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1079264 INFO  (searcherExecutor-1998-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard1_replica_n1 s:shard1 c:dv_coll r:core_node3) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore [dv_coll_shard1_replica_n1] Registered new searcher Searcher@4e6b927c[dv_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1079264 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575750774312402944
   [junit4]   2> 1079264 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1079265 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1079267 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1079267 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1079267 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/
   [junit4]   2> 1079267 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1079267 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SyncStrategy https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/ has no replicas
   [junit4]   2> 1079267 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1079270 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1079270 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1079270 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/
   [junit4]   2> 1079270 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1079270 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SyncStrategy https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/ has no replicas
   [junit4]   2> 1079272 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1079272 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/ shard3
   [junit4]   2> 1079280 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/ shard2
   [junit4]   2> 1079283 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 1079284 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1079284 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1079284 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:51565/solr/dv_coll_shard1_replica_n1/
   [junit4]   2> 1079284 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1079284 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:51565/solr/dv_coll_shard1_replica_n1/ has no replicas
   [junit4]   2> 1079285 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1079288 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1079288 INFO  (searcherExecutor-2000-thread-1-processing-n:127.0.0.1:51566_solr x:dv_coll_shard4_replica_n6 s:shard4 c:dv_coll r:core_node8) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrCore [dv_coll_shard4_replica_n6] Registered new searcher Searcher@1d598fc9[dv_coll_shard4_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1079289 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575750774338617344
   [junit4]   2> 1079291 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:51565/solr/dv_coll_shard1_replica_n1/ shard1
   [junit4]   2> 1079299 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1079299 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1079299 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:51566/solr/dv_coll_shard4_replica_n6/
   [junit4]   2> 1079300 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1079300 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SyncStrategy https://127.0.0.1:51566/solr/dv_coll_shard4_replica_n6/ has no replicas
   [junit4]   2> 1079300 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1079305 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:51566/solr/dv_coll_shard4_replica_n6/ shard4
   [junit4]   2> 1079412 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079412 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079412 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079412 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079416 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1079417 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=dv_coll_shard4_replica_n6&action=CREATE&numShards=4&collection=dv_coll&shard=shard4&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1293
   [junit4]   2> 1079437 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1079438 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1079439 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=dv_coll_shard3_replica_n4&action=CREATE&numShards=4&collection=dv_coll&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1337
   [junit4]   2> 1079439 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=dv_coll_shard2_replica_n2&action=CREATE&numShards=4&collection=dv_coll&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1318
   [junit4]   2> 1079467 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1079469 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=dv_coll_shard1_replica_n1&action=CREATE&numShards=4&collection=dv_coll&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1367
   [junit4]   2> 1079472 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1079578 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079578 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079578 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079578 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/dv_coll/state.json] for collection [dv_coll] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1079762 INFO  (OverseerCollectionConfigSetProcessor-98484423270268933-127.0.0.1:51566_solr-n_0000000000) [n:127.0.0.1:51566_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1080481 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&maxShardsPerNode=2&name=dv_coll&nrtReplicas=1&action=CREATE&numShards=4&wt=javabin&version=2} status=0 QTime=2724
   [junit4]   2> 1080510 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SchemaManager managed schema loaded . version : 0 
   [junit4]   2> 1080514 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema [dv_coll_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 1080535 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1080550 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.ZkController Persisted config data to node /configs/conf1/managed-schema 
   [junit4]   2> 1080550 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1080551 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1080551 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1080551 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.ZkIndexSchemaReader A schema change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/configs/conf1/managed-schema, has occurred - updating schema from ZooKeeper ...
   [junit4]   2> 1080552 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
   [junit4]   2> 1080553 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
   [junit4]   2> 1080555 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
   [junit4]   2> 1080559 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.IndexSchema [dv_coll_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 1080560 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.IndexSchema [dv_coll_shard4_replica_n6] Schema name=minimal
   [junit4]   2> 1080560 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.IndexSchema [dv_coll_shard2_replica_n2] Schema name=minimal
   [junit4]   2> 1080565 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1080567 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1080568 INFO  (zkCallback-846-thread-2-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 14 ms
   [junit4]   2> 1080568 INFO  (zkCallback-846-thread-1-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 13 ms
   [junit4]   2> 1080570 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1080570 INFO  (zkCallback-847-thread-2-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 18 ms
   [junit4]   2> 1080572 INFO  (Thread-1025) [n:127.0.0.1:51566_solr    ] o.a.s.c.SolrCore config update listener called for core dv_coll_shard4_replica_n6
   [junit4]   2> 1080572 INFO  (Thread-1026) [n:127.0.0.1:51565_solr    ] o.a.s.c.SolrCore config update listener called for core dv_coll_shard3_replica_n4
   [junit4]   2> 1080575 INFO  (Thread-1025) [n:127.0.0.1:51566_solr    ] o.a.s.c.SolrCore config update listener called for core dv_coll_shard2_replica_n2
   [junit4]   2> 1080575 INFO  (Thread-1026) [n:127.0.0.1:51565_solr    ] o.a.s.c.SolrCore core reload dv_coll_shard3_replica_n4
   [junit4]   2> 1080585 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
   [junit4]   2> 1080593 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema [dv_coll_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 1080614 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1080614 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.CoreContainer Reloading SolrCore 'dv_coll_shard3_replica_n4' using configuration from collection dv_coll
   [junit4]   2> 1080615 WARN  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1080615 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [[dv_coll_shard3_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/dv_coll_shard3_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/./dv_coll_shard3_replica_n4/data/]
   [junit4]   2> 1080662 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1080662 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1080664 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@757c3217[dv_coll_shard3_replica_n4] main]
   [junit4]   2> 1080665 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1080666 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1080666 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1080666 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
   [junit4]   2> 1080667 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1080667 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1575750775783555072
   [junit4]   2> 1080668 INFO  (searcherExecutor-2018-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard3_replica_n4 s:shard3 c:dv_coll r:core_node7) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4] Registered new searcher Searcher@757c3217[dv_coll_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1080670 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1080670 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@5c6160fe[dv_coll_shard3_replica_n4] main]
   [junit4]   2> 1080670 INFO  (searcherExecutor-2018-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard3_replica_n4 s:shard3 c:dv_coll r:core_node7) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4] Registered new searcher Searcher@5c6160fe[dv_coll_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1080671 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 1 from ZooKeeper
   [junit4]   2> 1080677 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ManagedIndexSchema Waiting up to 599 secs for 3 replicas to apply schema update version 1 for collection dv_coll
   [junit4]   2> 1080677 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.IndexSchema [dv_coll_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 1080683 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1080683 INFO  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.s.ZkIndexSchemaReader Finished refreshing schema in 11 ms
   [junit4]   2> 1080689 INFO  (Thread-1026) [n:127.0.0.1:51565_solr    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
   [junit4]   2> 1080695 INFO  (qtp294166047-6988) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.S.Request [dv_coll_shard2_replica_n2]  webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1080696 INFO  (qtp294166047-7002) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.S.Request [dv_coll_shard4_replica_n6]  webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1080701 INFO  (qtp1963771500-6994) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.S.Request [dv_coll_shard1_replica_n1]  webapp=/solr path=/schema/zkversion params={refreshIfBelowVersion=1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1080703 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ManagedIndexSchema Took 32.0ms for 3 replicas to apply schema update version 1 for collection dv_coll
   [junit4]   2> 1080703 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.S.Request [dv_coll_shard3_replica_n4]  webapp=/solr path=/schema params={wt=javabin&version=2} status=0 QTime=195
   [junit4]   2> 1080703 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4]  CLOSING SolrCore org.apache.solr.core.SolrCore@1260f4db
   [junit4]   2> 1080704 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.dv_coll.shard3.replica_n4, tag=308344027
   [junit4]   2> 1080704 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@588e3f93: rootName = solr_51565, domain = solr.core.dv_coll.shard3.replica_n4, service url = null, agent id = null] for registry solr.core.dv_coll.shard3.replica_n4 / null
   [junit4]   2> 1080704 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.dv_coll.shard3.leader, tag=308344027
   [junit4]   2> 1080707 INFO  (Thread-1026) [n:127.0.0.1:51565_solr    ] o.a.s.s.IndexSchema [dv_coll_shard3_replica_n4] Schema name=minimal
   [junit4]   2> 1080719 INFO  (Thread-1026) [n:127.0.0.1:51565_solr    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1080719 INFO  (Thread-1026) [n:127.0.0.1:51565_solr    ] o.a.s.c.CoreContainer Reloading SolrCore 'dv_coll_shard3_replica_n4' using configuration from collection dv_coll
   [junit4]   2> 1080723 WARN  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter No JMX server found. Not exposing Solr metrics via JMX.
   [junit4]   2> 1080724 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [[dv_coll_shard3_replica_n4] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/dv_coll_shard3_replica_n4], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001/tempDir-001/node2/./dv_coll_shard3_replica_n4/data/]
   [junit4]   2> 1080754 INFO  (TEST-DocValuesNotIndexedTest.testGroupingSorting-seed#[A948C8AD1BAE0C9A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testGroupingSorting
   [junit4]   2> 1080799 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard3_replica_n4]  webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=https://127.0.0.1:51566/solr/dv_coll_shard4_replica_n6/&wt=javabin&version=2}{deleteByQuery=*:* (-1575750775911481344)} 0 18
   [junit4]   2> 1080799 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard2_replica_n2]  webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=https://127.0.0.1:51566/solr/dv_coll_shard4_replica_n6/&wt=javabin&version=2}{deleteByQuery=*:* (-1575750775897849856)} 0 23
   [junit4]   2> 1080800 INFO  (qtp1963771500-6996) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=https://127.0.0.1:51566/solr/dv_coll_shard4_replica_n6/&wt=javabin&version=2}{deleteByQuery=*:* (-1575750775902044160)} 0 20
   [junit4]   2> 1080801 INFO  (qtp294166047-6988) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard4_replica_n6]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1575750775896801280)} 0 34
   [junit4]   2> 1080803 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775926161408,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080803 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775926161408,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080805 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775928258560,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080805 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775928258560,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080806 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1080807 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1080807 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1080808 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1080808 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1080808 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1080808 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@531b2b3f[dv_coll_shard2_replica_n2] main]
   [junit4]   2> 1080808 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080808 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard3_replica_n4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 4
   [junit4]   2> 1080809 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080809 INFO  (searcherExecutor-2001-thread-1-processing-n:127.0.0.1:51566_solr x:dv_coll_shard2_replica_n2 s:shard2 c:dv_coll r:core_node5) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore [dv_coll_shard2_replica_n2] Registered new searcher Searcher@531b2b3f[dv_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1080809 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard2_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 6
   [junit4]   2> 1080810 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6925c8cc[dv_coll_shard1_replica_n1] main]
   [junit4]   2> 1080810 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@37a08c45[dv_coll_shard4_replica_n6] main]
   [junit4]   2> 1080811 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080811 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080811 INFO  (searcherExecutor-1998-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard1_replica_n1 s:shard1 c:dv_coll r:core_node3) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore [dv_coll_shard1_replica_n1] Registered new searcher Searcher@6925c8cc[dv_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1080811 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 9
   [junit4]   2> 1080811 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@3548585e[dv_coll_shard3_replica_n4] main]
   [junit4]   2> 1080811 INFO  (searcherExecutor-2000-thread-1-processing-n:127.0.0.1:51566_solr x:dv_coll_shard4_replica_n6 s:shard4 c:dv_coll r:core_node8) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.SolrCore [dv_coll_shard4_replica_n6] Registered new searcher Searcher@37a08c45[dv_coll_shard4_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1080812 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard4_replica_n6]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 6
   [junit4]   2> 1080812 INFO  (qtp294166047-7000) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard2_replica_n2]  webapp=/solr path=/update params={_stateVer_=dv_coll:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 10
   [junit4]   2> 1080813 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1080814 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1080814 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
   [junit4]   2> 1080815 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.ZkIndexSchemaReader Current schema version 1 is already the latest
   [junit4]   2> 1080815 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1080815 INFO  (searcherExecutor-2023-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard3_replica_n4 s:shard3 c:dv_coll r:core_node7) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4] Registered new searcher Searcher@3548585e[dv_coll_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1080822 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=dv_coll:4&wt=javabin&version=2}{add=[1 (1575750775943987200)]} 0 1
   [junit4]   2> 1080822 INFO  (qtp294166047-6988) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard2_replica_n2]  webapp=/solr path=/update params={_stateVer_=dv_coll:4&wt=javabin&version=2}{add=[4 (1575750775941890048)]} 0 4
   [junit4]   2> 1080851 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1080854 INFO  (qtp1963771500-6990) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard3_replica_n4]  webapp=/solr path=/update params={_stateVer_=dv_coll:4&wt=javabin&version=2}{add=[2 (1575750775941890048), 3 (1575750775943987200)]} 0 36
   [junit4]   2> 1080859 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775984881664,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080859 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775984881664,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080859 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1080859 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@461aa929 commitCommandVersion:1575750775984881664
   [junit4]   2> 1080860 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080860 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775985930240,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080860 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@2050b6d7 commitCommandVersion:1575750775985930240
   [junit4]   2> 1080860 INFO  (qtp294166047-6991) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard4_replica_n6]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
   [junit4]   2> 1080862 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1575750775988027392,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1080862 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@2eacbf34 commitCommandVersion:1575750775988027392
   [junit4]   2> 1080867 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@5776d8f7[dv_coll_shard3_replica_n4] main]
   [junit4]   2> 1080868 INFO  (Thread-1026) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore config update listener called for core dv_coll_shard1_replica_n1
   [junit4]   2> 1080868 INFO  (searcherExecutor-2023-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard3_replica_n4 s:shard3 c:dv_coll r:core_node7) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4] Registered new searcher Searcher@5776d8f7[dv_coll_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C1)))}
   [junit4]   2> 1080900 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@6852131c[dv_coll_shard2_replica_n2] main]
   [junit4]   2> 1080901 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080901 INFO  (searcherExecutor-2001-thread-1-processing-n:127.0.0.1:51566_solr x:dv_coll_shard2_replica_n2 s:shard2 c:dv_coll r:core_node5) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.SolrCore [dv_coll_shard2_replica_n2] Registered new searcher Searcher@6852131c[dv_coll_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C1)))}
   [junit4]   2> 1080901 INFO  (qtp294166047-7004) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard2_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 41
   [junit4]   2> 1080904 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6ec1025a[dv_coll_shard1_replica_n1] main]
   [junit4]   2> 1080904 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080905 INFO  (searcherExecutor-1998-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard1_replica_n1 s:shard1 c:dv_coll r:core_node3) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore [dv_coll_shard1_replica_n1] Registered new searcher Searcher@6ec1025a[dv_coll_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C1)))}
   [junit4]   2> 1080905 INFO  (qtp1963771500-6995) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 43
   [junit4]   2> 1080910 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@6e454782[dv_coll_shard3_replica_n4] main]
   [junit4]   2> 1080910 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1080911 INFO  (searcherExecutor-2018-thread-1-processing-n:127.0.0.1:51565_solr x:dv_coll_shard3_replica_n4 s:shard3 c:dv_coll r:core_node7) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4] Registered new searcher Searcher@6e454782[dv_coll_shard3_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.1.0):C1) Uninverting(_1(7.1.0):C1)))}
   [junit4]   2> 1080911 INFO  (qtp1963771500-6997) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard3_replica_n4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 51
   [junit4]   2> 1080911 INFO  (qtp1963771500-6996) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.u.p.LogUpdateProcessorFactory [dv_coll_shard3_replica_n4]  webapp=/solr path=/update params={_stateVer_=dv_coll:4&commit=true&wt=javabin&version=2}{commit=} 0 56
   [junit4]   2> 1080911 INFO  (qtp1963771500-6996) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.SolrCore [dv_coll_shard3_replica_n4]  CLOSING SolrCore org.apache.solr.core.SolrCore@344abaf4
   [junit4]   2> 1080912 INFO  (qtp1963771500-6996) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.dv_coll.shard3.replica_n4, tag=877312756
   [junit4]   2> 1080912 INFO  (qtp1963771500-6996) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@67a2ea7a: rootName = solr_51565, domain = solr.core.dv_coll.shard3.replica_n4, service url = null, agent id = null] for registry solr.core.dv_coll.shard3.replica_n4 / null
   [junit4]   2> 1080912 INFO  (qtp1963771500-6996) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.dv_coll.shard3.leader, tag=877312756
   [junit4]   2> 1080914 INFO  (qtp294166047-7002) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.c.S.Request [dv_coll_shard4_replica_n6]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=dv_coll:4&fl=id&shards.purpose=4&start=0&fsv=true&sort=intGSF+asc,id+asc&shard.url=https://127.0.0.1:51566/solr/dv_coll_shard4_replica_n6/&rows=100&version=2&q=*:*&NOW=1502753044168&isShard=true&wt=javabin} hits=0 status=0 QTime=0
   [junit4]   2> 1080914 INFO  (qtp1963771500-6990) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.S.Request [dv_coll_shard3_replica_n4]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=dv_coll:4&fl=id&shards.purpose=4&start=0&fsv=true&sort=intGSF+asc,id+asc&shard.url=https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/&rows=100&version=2&q=*:*&NOW=1502753044168&isShard=true&wt=javabin} hits=1 status=0 QTime=0
   [junit4]   2> 1080914 INFO  (qtp1963771500-6998) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.S.Request [dv_coll_shard1_replica_n1]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=dv_coll:4&fl=id&shards.purpose=4&start=0&fsv=true&sort=intGSF+asc,id+asc&shard.url=https://127.0.0.1:51565/solr/dv_coll_shard1_replica_n1/&rows=100&version=2&q=*:*&NOW=1502753044168&isShard=true&wt=javabin} hits=1 status=0 QTime=0
   [junit4]   2> 1080916 INFO  (qtp294166047-6988) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.S.Request [dv_coll_shard2_replica_n2]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=dv_coll:4&fl=id&shards.purpose=4&start=0&fsv=true&sort=intGSF+asc,id+asc&shard.url=https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/&rows=100&version=2&q=*:*&NOW=1502753044168&isShard=true&wt=javabin} hits=1 status=0 QTime=0
   [junit4]   2> 1080917 INFO  (qtp294166047-7002) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.c.S.Request [dv_coll_shard2_replica_n2]  webapp=/solr path=/select params={q=*:*&df=text&distrib=false&_stateVer_=dv_coll:4&shards.purpose=64&NOW=1502753044168&ids=4&isShard=true&shard.url=https://127.0.0.1:51566/solr/dv_coll_shard2_replica_n2/&rows=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1080917 INFO  (qtp1963771500-6993) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.c.S.Request [dv_coll_shard3_replica_n4]  webapp=/solr path=/select params={q=*:*&df=text&distrib=false&_stateVer_=dv_coll:4&shards.purpose=64&NOW=1502753044168&ids=2&isShard=true&shard.url=https://127.0.0.1:51565/solr/dv_coll_shard3_replica_n4/&rows=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1080917 INFO  (qtp1963771500-6994) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.S.Request [dv_coll_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&df=text&distrib=false&_stateVer_=dv_coll:4&shards.purpose=64&NOW=1502753044168&ids=1&isShard=true&shard.url=https://127.0.0.1:51565/solr/dv_coll_shard1_replica_n1/&rows=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]  

[...truncated too long message...]

read-2) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.c.SolrCore [dv_coll_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@61c2ef0
   [junit4]   2> 1081433 INFO  (coreCloseExecutor-2027-thread-2) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.dv_coll.shard4.replica_n6, tag=662476205
   [junit4]   2> 1081433 INFO  (coreCloseExecutor-2027-thread-2) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@12504451: rootName = solr_51566, domain = solr.core.dv_coll.shard4.replica_n6, service url = null, agent id = null] for registry solr.core.dv_coll.shard4.replica_n6 / null
   [junit4]   2> 1081433 INFO  (coreCloseExecutor-2027-thread-2) [n:127.0.0.1:51566_solr c:dv_coll s:shard4 r:core_node8 x:dv_coll_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.dv_coll.shard4.leader, tag=662476205
   [junit4]   2> 1081438 INFO  (coreCloseExecutor-2028-thread-2) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.dv_coll.shard1.replica_n1, tag=102510320
   [junit4]   2> 1081438 INFO  (coreCloseExecutor-2028-thread-2) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3d7064c4: rootName = solr_51565, domain = solr.core.dv_coll.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.dv_coll.shard1.replica_n1 / null
   [junit4]   2> 1081438 INFO  (coreCloseExecutor-2028-thread-2) [n:127.0.0.1:51565_solr c:dv_coll s:shard1 r:core_node3 x:dv_coll_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.dv_coll.shard1.leader, tag=102510320
   [junit4]   2> 1081439 INFO  (coreCloseExecutor-2027-thread-1) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.dv_coll.shard2.replica_n2, tag=1914963165
   [junit4]   2> 1081439 INFO  (coreCloseExecutor-2027-thread-1) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@658447e1: rootName = solr_51566, domain = solr.core.dv_coll.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.dv_coll.shard2.replica_n2 / null
   [junit4]   2> 1081439 INFO  (coreCloseExecutor-2027-thread-1) [n:127.0.0.1:51566_solr c:dv_coll s:shard2 r:core_node5 x:dv_coll_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.dv_coll.shard2.leader, tag=1914963165
   [junit4]   2> 1081439 INFO  (coreCloseExecutor-2028-thread-1) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.dv_coll.shard3.replica_n4, tag=1776995902
   [junit4]   2> 1081439 INFO  (coreCloseExecutor-2028-thread-1) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@51ec4cd5: rootName = solr_51565, domain = solr.core.dv_coll.shard3.replica_n4, service url = null, agent id = null] for registry solr.core.dv_coll.shard3.replica_n4 / null
   [junit4]   2> 1081439 INFO  (coreCloseExecutor-2028-thread-1) [n:127.0.0.1:51565_solr c:dv_coll s:shard3 r:core_node7 x:dv_coll_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.dv_coll.shard3.leader, tag=1776995902
   [junit4]   2> 1081442 INFO  (jetty-closer-836-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98484423270268933-127.0.0.1:51566_solr-n_0000000000) closing
   [junit4]   2> 1081442 INFO  (OverseerStateUpdate-98484423270268933-127.0.0.1:51566_solr-n_0000000000) [n:127.0.0.1:51566_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:51566_solr
   [junit4]   2> 1081444 WARN  (zkCallback-847-thread-1-processing-n:127.0.0.1:51565_solr) [n:127.0.0.1:51565_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1081445 INFO  (jetty-closer-836-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@43f8d834{/solr,null,UNAVAILABLE}
   [junit4]   2> 1082944 WARN  (zkCallback-846-thread-3-processing-n:127.0.0.1:51566_solr) [n:127.0.0.1:51566_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1082945 INFO  (jetty-closer-836-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@71a6fef5{/solr,null,UNAVAILABLE}
   [junit4]   2> 1082946 ERROR (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1082946 INFO  (SUITE-DocValuesNotIndexedTest-seed#[A948C8AD1BAE0C9A]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51563 51563
   [junit4]   2> 1082965 INFO  (Thread-1006) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51563 51563
   [junit4]   2> 1083081 WARN  (Thread-1006) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/configs/conf1/managed-schema
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/collections/dv_coll/state.json
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/configs/conf1/managed-schema
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DocValuesNotIndexedTest_A948C8AD1BAE0C9A-001
   [junit4]   2> Aug 14, 2017 11:24:06 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=FST50}, docValues:{floatField=DocValuesFormat(name=Memory), doubleField=DocValuesFormat(name=Direct), intFieldMulti=DocValuesFormat(name=Memory), boolFieldMulti=DocValuesFormat(name=Direct), floatGSL=DocValuesFormat(name=Lucene70), longFieldMulti=DocValuesFormat(name=Asserting), intField=DocValuesFormat(name=Direct), boolField=DocValuesFormat(name=Lucene70), stringFieldMulti=DocValuesFormat(name=Lucene70), dateFieldMulti=DocValuesFormat(name=Asserting), longGSF=DocValuesFormat(name=Memory), doubleFieldMulti=DocValuesFormat(name=Lucene70), stringGSL=DocValuesFormat(name=Asserting), doubleGSF=DocValuesFormat(name=Direct), doubleGSL=DocValuesFormat(name=Asserting), stringGSF=DocValuesFormat(name=Direct), intGSL=DocValuesFormat(name=Direct), longField=DocValuesFormat(name=Memory), dateField=DocValuesFormat(name=Lucene70), dateGSF=DocValuesFormat(name=Lucene70), boolGSF=DocValuesFormat(name=Lucene70), longGSL=DocValuesFormat(name=Lucene70), boolGSL=DocValuesFormat(name=Memory), floatFieldMulti=DocValuesFormat(name=Direct), floatGSF=DocValuesFormat(name=Memory), dateGSL=DocValuesFormat(name=Memory), _version_=DocValuesFormat(name=Memory), intGSF=DocValuesFormat(name=Asserting), stringField=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=187, maxMBSortInHeap=6.316292457253301, sim=RandomSimilarity(queryNorm=true): {}, locale=ja, timezone=Europe/Helsinki
   [junit4]   2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=3,threads=1,free=35623752,total=192937984
   [junit4]   2> NOTE: All tests run in this JVM: [SolrCloudExampleTest, TestCoreAdminApis, TestSQLHandlerNonCloud, CloudExitableDirectoryReaderTest, FacetPivotSmallTest, LeaderElectionTest, TestRTimerTree, TestDistribIDF, SolrMetricReporterTest, TestSort, TestJsonFacets, TestQueryWrapperFilter, RemoteQueryErrorTest, TestDocBasedVersionConstraints, SimpleCollectionCreateDeleteTest, TestSolrDeletionPolicy2, BasicDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest, ResponseHeaderTest, DistribDocExpirationUpdateProcessorTest, TestCollectionsAPIViaSolrCloudCluster, TestImpersonationWithHadoopAuth, DistributedExpandComponentTest, TestCustomDocTransformer, TestSolrXml, DistributedFacetPivotSmallAdvancedTest, TestLegacyFieldCache, TestJmxIntegration, TestSubQueryTransformerDistrib, DeleteStatusTest, SolrJmxReporterCloudTest, TestHashQParserPlugin, DateFieldTest, SimpleFacetsTest, TestExactStatsCache, SolrIndexSplitterTest, ConcurrentDeleteAndCreateCollectionTest, AddBlockUpdateTest, BaseCdcrDistributedZkTest, BinaryUpdateRequestHandlerTest, RequestHandlersTest, TestSchemalessBufferedUpdates, TriLevelCompositeIdRoutingTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, ReturnFieldsTest, TestManagedSynonymGraphFilterFactory, TestSolrCoreSnapshots, TestWriterPerf, BasicAuthIntegrationTest, SparseHLLTest, DistributedQueueTest, TestSmileRequest, DocValuesNotIndexedTest]
   [junit4] Completed [161/729 (1!)] on J0 in 6.53s, 4 tests, 1 failure <<< FAILURES!

[...truncated 45286 lines...]

Mime
View raw message