lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS-EA] Lucene-Solr-7.2-Linux (64bit/jdk-10-ea+32) - Build # 106 - Still Unstable!
Date Sat, 23 Dec 2017 17:21:21 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.2-Linux/106/
Java: 64bit/jdk-10-ea+32 -XX:+UseCompressedOops -XX:+UseSerialGC

6 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.ltr.TestLTROnSolrCloud

Error Message:
62 threads leaked from SUITE scope at org.apache.solr.ltr.TestLTROnSolrCloud:     1) Thread[id=216, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)    2) Thread[id=282, name=searcherExecutor-151-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)    3) Thread[id=290, name=zkCallback-37-thread-2, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)    4) Thread[id=284, name=ScheduledTrigger-140-thread-4, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)    5) Thread[id=280, name=searcherExecutor-152-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)    6) Thread[id=250, name=TEST-TestLTROnSolrCloud.testSimpleQuery-seed#[6D62B4529345FAD6]-EventThread, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)    7) Thread[id=281, name=searcherExecutor-149-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)    8) Thread[id=202, name=qtp2065705475-202-acceptor-0@2681467b-ServerConnector@7cceb034{SSL,[ssl, http/1.1]}{127.0.0.1:39903}, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)         at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)    9) Thread[id=207, name=org.eclipse.jetty.server.session.HashSessionManager@3aaa5179Timer, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   10) Thread[id=254, name=OverseerThreadFactory-142-thread-1, state=WAITING, group=Overseer collection creation process.]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ExecutorCompletionService.take(ExecutorCompletionService.java:200)         at app//org.apache.solr.handler.component.HttpShardHandler.take(HttpShardHandler.java:248)         at app//org.apache.solr.handler.component.HttpShardHandler.takeCompletedOrError(HttpShardHandler.java:241)         at app//org.apache.solr.cloud.OverseerCollectionMessageHandler.processResponses(OverseerCollectionMessageHandler.java:728)         at app//org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:297)         at app//org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:233)         at app//org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$226/1686923341.run(Unknown Source)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   11) Thread[id=227, name=jetty-launcher-21-thread-1-EventThread, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   12) Thread[id=198, name=qtp2065705475-198, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:768)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:737)         at app//org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1079)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1014)         at app//org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)         at app//org.apache.solr.core.ZkContainer$$Lambda$282/281721207.run(Unknown Source)         at app//org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)         at app//org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$194/721364921.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)         at app//org.eclipse.jetty.server.Server.handle(Server.java:534)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   13) Thread[id=279, name=searcherExecutor-148-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   14) Thread[id=182, name=SessionTracker, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Object.wait(Native Method)         at app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)   15) Thread[id=266, name=qtp2065705475-266, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   16) Thread[id=268, name=qtp2065705475-268, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   17) Thread[id=267, name=qtp1396393121-267, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   18) Thread[id=283, name=searcherExecutor-150-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   19) Thread[id=225, name=jetty-launcher-21-thread-2-EventThread, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   20) Thread[id=265, name=qtp2065705475-265, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:768)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:737)         at app//org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1079)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1014)         at app//org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)         at app//org.apache.solr.core.ZkContainer$$Lambda$282/281721207.run(Unknown Source)         at app//org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)         at app//org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$194/721364921.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)         at app//org.eclipse.jetty.server.Server.handle(Server.java:534)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   21) Thread[id=180, name=Thread-54, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Object.wait(Native Method)         at java.base@10-ea/java.lang.Thread.join(Thread.java:1353)         at java.base@10-ea/java.lang.Thread.join(Thread.java:1427)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:297)         at app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:309)         at app//org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:490)   22) Thread[id=200, name=qtp2065705475-200, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   23) Thread[id=249, name=TEST-TestLTROnSolrCloud.testSimpleQuery-seed#[6D62B4529345FAD6]-SendThread(127.0.0.1:40883), state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)   24) Thread[id=203, name=qtp2065705475-203, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   25) Thread[id=237, name=ScheduledTrigger-140-thread-2, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   26) Thread[id=264, name=qtp1396393121-264, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   27) Thread[id=190, name=qtp1396393121-190, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   28) Thread[id=233, name=OverseerCollectionConfigSetProcessor-99224736555859974-127.0.0.1:39903_solr-n_0000000000, state=TIMED_WAITING, group=Overseer collection creation process.]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)         at app//org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:235)         at app//org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:228)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   29) Thread[id=217, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   30) Thread[id=199, name=qtp1396393121-199, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:768)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:737)         at app//org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1079)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1014)         at app//org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)         at app//org.apache.solr.core.ZkContainer$$Lambda$282/281721207.run(Unknown Source)         at app//org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)         at app//org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$194/721364921.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)         at app//org.eclipse.jetty.server.Server.handle(Server.java:534)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   31) Thread[id=251, name=zkConnectionManagerCallback-51-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   32) Thread[id=194, name=qtp1396393121-194, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:768)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:737)         at app//org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1079)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1014)         at app//org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)         at app//org.apache.solr.core.ZkContainer$$Lambda$282/281721207.run(Unknown Source)         at app//org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)         at app//org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$194/721364921.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)         at app//org.eclipse.jetty.server.Server.handle(Server.java:534)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   33) Thread[id=206, name=qtp2065705475-206, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   34) Thread[id=263, name=qtp1396393121-263, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   35) Thread[id=195, name=qtp1396393121-195-acceptor-0@78229b9a-ServerConnector@6616881a{SSL,[ssl, http/1.1]}{127.0.0.1:38677}, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)         at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   36) Thread[id=193, name=qtp1396393121-193, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:768)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:737)         at app//org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1079)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1014)         at app//org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)         at app//org.apache.solr.core.ZkContainer$$Lambda$282/281721207.run(Unknown Source)         at app//org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)         at app//org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$194/721364921.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)         at app//org.eclipse.jetty.server.Server.handle(Server.java:534)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   37) Thread[id=228, name=zkConnectionManagerCallback-38-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   38) Thread[id=235, name=OverseerAutoScalingTriggerThread-99224736555859974-127.0.0.1:39903_solr-n_0000000000, state=WAITING, group=Overseer autoscaling triggers]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:166)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   39) Thread[id=184, name=ProcessThread(sid:0 cport:40883):, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:122)   40) Thread[id=191, name=qtp2065705475-191, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:768)         at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:737)         at app//org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1079)         at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1014)         at app//org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)         at app//org.apache.solr.core.ZkContainer$$Lambda$282/281721207.run(Unknown Source)         at app//org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)         at app//org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$194/721364921.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)         at app//org.eclipse.jetty.server.Server.handle(Server.java:534)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   41) Thread[id=215, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   42) Thread[id=236, name=ScheduledTrigger-140-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   43) Thread[id=234, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   44) Thread[id=201, name=qtp1396393121-201, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   45) Thread[id=204, name=org.eclipse.jetty.server.session.HashSessionManager@11083685Timer, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   46) Thread[id=214, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   47) Thread[id=229, name=zkConnectionManagerCallback-40-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   48) Thread[id=289, name=zkCallback-39-thread-3, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@10-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   49) Thread[id=285, name=searcherExecutor-147-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   50) Thread[id=197, name=qtp1396393121-197, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   51) Thread[id=181, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at app//org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:173)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   52) Thread[id=224, name=jetty-launcher-21-thread-2-SendThread(127.0.0.1:40883), state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)   53) Thread[id=252, name=Scheduler-1505963985, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   54) Thread[id=272, name=ScheduledTrigger-140-thread-3, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   55) Thread[id=240, name=Thread-72, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Object.wait(Native Method)         at java.base@10-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)   56) Thread[id=253, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   57) Thread[id=245, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   58) Thread[id=205, name=qtp2065705475-205, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   59) Thread[id=232, name=OverseerStateUpdate-99224736555859974-127.0.0.1:39903_solr-n_0000000000, state=TIMED_WAITING, group=Overseer state updater.]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:463)         at app//org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:203)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   60) Thread[id=260, name=Scheduler-863974366, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)   61) Thread[id=226, name=jetty-launcher-21-thread-1-SendThread(127.0.0.1:40883), state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)         at app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)   62) Thread[id=238, name=Thread-71, state=WAITING, group=TGRP-TestLTROnSolrCloud]         at java.base@10-ea/java.lang.Object.wait(Native Method)         at java.base@10-ea/java.lang.Object.wait(Object.java:328)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 62 threads leaked from SUITE scope at org.apache.solr.ltr.TestLTROnSolrCloud: 
   1) Thread[id=216, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=282, name=searcherExecutor-151-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
        at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   3) Thread[id=290, name=zkCallback-37-thread-2, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@10-ea/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@10-ea/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1060)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   4) Thread[id=284, name=ScheduledTrigger-140-thread-4, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
        at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
        at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   5) Thread[id=280, name=searcherExecutor-152-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
        at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   6) Thread[id=250, name=TEST-TestLTROnSolrCloud.testSimpleQuery-seed#[6D62B4529345FAD6]-EventThread, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
        at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
   7) Thread[id=281, name=searcherExecutor-149-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
        at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   8) Thread[id=202, name=qtp2065705475-202-acceptor-0@2681467b-ServerConnector@7cceb034{SSL,[ssl, http/1.1]}{127.0.0.1:39903}, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)
        at java.base@10-ea/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   9) Thread[id=207, name=org.eclipse.jetty.server.session.HashSessionManager@3aaa5179Timer, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2116)
        at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
        at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
  10) Thread[id=254, name=OverseerThreadFactory-142-thread-1, state=WAITING, group=Overseer collection creation process.]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
        at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@10-ea/java.util.concurrent.ExecutorCompletionService.take(ExecutorCompletionService.java:200)
        at app//org.apache.solr.handler.component.HttpShardHandler.take(HttpShardHandler.java:248)
        at app//org.apache.solr.handler.component.HttpShardHandler.takeCompletedOrError(HttpShardHandler.java:241)
        at app//org.apache.solr.cloud.OverseerCollectionMessageHandler.processResponses(OverseerCollectionMessageHandler.java:728)
        at app//org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:297)
        at app//org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:233)
        at app//org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$226/1686923341.run(Unknown Source)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
        at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
  11) Thread[id=227, name=jetty-launcher-21-thread-1-EventThread, state=WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
        at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
  12) Thread[id=198, name=qtp2065705475-198, state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
        at java.base@10-ea/java.lang.Thread.sleep(Native Method)
        at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:768)
        at app//org.apache.solr.common.cloud.ZkStateReader.getLeaderUrl(ZkStateReader.java:737)
        at app//org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1178)
        at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1079)
        at app//org.apache.solr.cloud.ZkController.register(ZkController.java:1014)
        at app//org.apache.solr.core.ZkContainer.lambda$registerInZk$0(ZkContainer.java:181)
        at app//org.apache.solr.core.ZkContainer$$Lambda$282/281721207.run(Unknown Source)
        at app//org.apache.solr.core.ZkContainer.registerInZk(ZkContainer.java:208)
        at app//org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:886)
        at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1047)
        at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:948)
        at a

[...truncated too long message...]

ProduceConsume.java:148)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]    >         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >   23) Thread[id=190, name=qtp1396393121-190, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:313)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:206)
   [junit4]    >         at java.base@10-ea/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
   [junit4]    >         at java.base@10-ea/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:91)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]    >         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >   24) Thread[id=240, name=Thread-72, state=WAITING, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/java.lang.Object.wait(Native Method)
   [junit4]    >         at java.base@10-ea/java.lang.Object.wait(Object.java:328)
   [junit4]    >         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
   [junit4]    >   25) Thread[id=251, name=zkConnectionManagerCallback-51-thread-1, state=WAITING, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]    >         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >   26) Thread[id=260, name=Scheduler-863974366, state=WAITING, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2074)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1170)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1121)
   [junit4]    >         at java.base@10-ea/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
   [junit4]    >         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >   27) Thread[id=206, name=qtp2065705475-206, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]    >         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >   28) Thread[id=263, name=qtp1396393121-263, state=RUNNABLE, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:313)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:206)
   [junit4]    >         at java.base@10-ea/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
   [junit4]    >         at java.base@10-ea/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:91)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:89)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:100)
   [junit4]    >         at java.base@10-ea/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:104)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
   [junit4]    >         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]    >         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]    >         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >   29) Thread[id=226, name=jetty-launcher-21-thread-1-SendThread(127.0.0.1:40883), state=TIMED_WAITING, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/java.lang.Thread.sleep(Native Method)
   [junit4]    >         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
   [junit4]    >         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
   [junit4]    >   30) Thread[id=238, name=Thread-71, state=WAITING, group=TGRP-TestLTROnSolrCloud]
   [junit4]    >         at java.base@10-ea/java.lang.Object.wait(Native Method)
   [junit4]    >         at java.base@10-ea/java.lang.Object.wait(Object.java:328)
   [junit4]    >         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1717)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6D62B4529345FAD6]:0)
   [junit4] Completed [35/35 (1!)] on J0 in 204.74s, 1 test, 3 errors <<< FAILURES!

[...truncated 32842 lines...]

Mime
View raw message