lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-master-Linux (64bit/jdk-9.0.1) - Build # 21106 - Unstable!
Date Tue, 19 Dec 2017 03:14:32 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21106/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseG1GC

7 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestExecutePlanAction

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([E1F120F164B118E9]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.schema.TestCloudSchemaless

Error Message:
66 threads leaked from SUITE scope at org.apache.solr.schema.TestCloudSchemaless:     1) Thread[id=9502, name=qtp237771039-9502, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    2) Thread[id=9508, name=qtp237771039-9508, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    3) Thread[id=9453, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    4) Thread[id=9515, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    5) Thread[id=9546, name=zkCallback-4682-thread-3, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    6) Thread[id=9441, name=qtp209635969-9441, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    7) Thread[id=9521, name=zkConnectionManagerCallback-4683-thread-1, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    8) Thread[id=9447, name=qtp209635969-9447, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)    9) Thread[id=9545, name=zkCallback-4662-thread-8, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   10) Thread[id=9544, name=zkCallback-4662-thread-7, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   11) Thread[id=9509, name=qtp237771039-9509, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   12) Thread[id=9525, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   13) Thread[id=9540, name=zkCallback-4662-thread-4-processing-n:127.0.0.1:34557_, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)         at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)         at app//org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:494)         at app//org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:437)         at app//org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)         at app//org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:788)         at app//org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)         at app//org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)         at app//org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)         at app//org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)         at app//org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268)         at app//org.apache.solr.common.cloud.SolrZkClient$1$$Lambda$386/549212709.run(Unknown Source)         at java.base@9.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)         at java.base@9.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$224/285047550.run(Unknown Source)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   14) Thread[id=9488, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-SendThread(127.0.0.1:35421), state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)   15) Thread[id=9468, name=searcherExecutor-1305-thread-1, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   16) Thread[id=9489, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-EventThread, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   17) Thread[id=9520, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-EventThread, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   18) Thread[id=9550, name=zkCallback-4672-thread-4, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   19) Thread[id=9442, name=qtp209635969-9442, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   20) Thread[id=9483, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   21) Thread[id=9484, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   22) Thread[id=9507, name=qtp237771039-9507, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1562)         at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1513)         at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1622)         at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036)         at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:954)         at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)         at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$192/1127479847.execute(Unknown Source)         at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)         at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)         at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)         at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)         at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)         at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)         at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)         at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)         at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)         at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)         at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)         at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)         at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)         at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)         at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)         at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)         at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)         at app//org.eclipse.jetty.server.Server.handle(Server.java:534)         at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)         at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)         at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)         at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)         at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   23) Thread[id=9458, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-EventThread, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)   24) Thread[id=9548, name=zkCallback-4682-thread-5, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   25) Thread[id=9475, name=qtp891544163-9475-acceptor-0@5c43bc69-ServerConnector@52845991{HTTP/1.1,[http/1.1]}{127.0.0.1:45145}, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   26) Thread[id=9478, name=qtp891544163-9478, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   27) Thread[id=9446, name=qtp209635969-9446, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   28) Thread[id=9461, name=Thread-476, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Object.wait(Native Method)         at java.base@9.0.1/java.lang.Object.wait(Object.java:516)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1725)   29) Thread[id=9479, name=org.eclipse.jetty.server.session.HashSessionManager@5d5b0740Timer, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   30) Thread[id=9463, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   31) Thread[id=9519, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-SendThread(127.0.0.1:35421), state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)   32) Thread[id=9542, name=zkCallback-4662-thread-5, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   33) Thread[id=9440, name=qtp209635969-9440, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   34) Thread[id=9445, name=qtp209635969-9445, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   35) Thread[id=9551, name=zkCallback-4672-thread-5, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   36) Thread[id=9464, name=Scheduler-1393464100, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1119)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   37) Thread[id=9470, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   38) Thread[id=9503, name=qtp237771039-9503, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   39) Thread[id=9504, name=qtp237771039-9504, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   40) Thread[id=9476, name=qtp891544163-9476, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   41) Thread[id=9457, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-SendThread(127.0.0.1:35421), state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)         at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)   42) Thread[id=9492, name=Thread-485, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Object.wait(Native Method)         at java.base@9.0.1/java.lang.Object.wait(Object.java:516)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1725)   43) Thread[id=9547, name=zkCallback-4682-thread-4, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   44) Thread[id=9471, name=qtp891544163-9471, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   45) Thread[id=9472, name=qtp891544163-9472, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   46) Thread[id=9477, name=qtp891544163-9477, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   47) Thread[id=9506, name=qtp237771039-9506-acceptor-0@5ae58418-ServerConnector@54226134{HTTP/1.1,[http/1.1]}{127.0.0.1:44619}, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   48) Thread[id=9527, name=Scheduler-1932007875, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   49) Thread[id=9543, name=zkCallback-4662-thread-6, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   50) Thread[id=9448, name=org.eclipse.jetty.server.session.HashSessionManager@4a762506Timer, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   51) Thread[id=9452, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   52) Thread[id=9499, name=searcherExecutor-1316-thread-1, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   53) Thread[id=9474, name=qtp891544163-9474, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   54) Thread[id=9549, name=zkCallback-4672-thread-3, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)         at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   55) Thread[id=9494, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   56) Thread[id=9473, name=qtp891544163-9473, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   57) Thread[id=9443, name=qtp209635969-9443, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   58) Thread[id=9523, name=Thread-494, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Object.wait(Native Method)         at java.base@9.0.1/java.lang.Object.wait(Object.java:516)         at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:1725)   59) Thread[id=9490, name=zkConnectionManagerCallback-4673-thread-1, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   60) Thread[id=9444, name=qtp209635969-9444-acceptor-0@2edff55b-ServerConnector@1da2240c{HTTP/1.1,[http/1.1]}{127.0.0.1:34557}, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)         at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)         at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)         at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   61) Thread[id=9459, name=zkConnectionManagerCallback-4663-thread-1, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   62) Thread[id=9514, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   63) Thread[id=9501, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/java.lang.Thread.sleep(Native Method)         at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   64) Thread[id=9496, name=Scheduler-958447446, state=WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1119)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   65) Thread[id=9510, name=org.eclipse.jetty.server.session.HashSessionManager@4fdbfcfdTimer, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1131)         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)   66) Thread[id=9505, name=qtp237771039-9505, state=RUNNABLE, group=TGRP-TestCloudSchemaless]         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)         at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)         at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)         at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)         at app//org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)         at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 66 threads leaked from SUITE scope at org.apache.solr.schema.TestCloudSchemaless: 
   1) Thread[id=9502, name=qtp237771039-9502, state=RUNNABLE, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)
        at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   2) Thread[id=9508, name=qtp237771039-9508, state=RUNNABLE, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)
        at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   3) Thread[id=9453, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   4) Thread[id=9515, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   5) Thread[id=9546, name=zkCallback-4682-thread-3, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   6) Thread[id=9441, name=qtp209635969-9441, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   7) Thread[id=9521, name=zkConnectionManagerCallback-4683-thread-1, state=WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   8) Thread[id=9447, name=qtp209635969-9447, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   9) Thread[id=9545, name=zkCallback-4662-thread-8, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  10) Thread[id=9544, name=zkCallback-4662-thread-7, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  11) Thread[id=9509, name=qtp237771039-9509, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  12) Thread[id=9525, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  13) Thread[id=9540, name=zkCallback-4662-thread-4-processing-n:127.0.0.1:34557_, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
        at app//org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
        at app//org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:494)
        at app//org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:437)
        at app//org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:424)
        at app//org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:788)
        at app//org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
        at app//org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
        at app//org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
        at app//org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
        at app//org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$1(SolrZkClient.java:268)
        at app//org.apache.solr.common.cloud.SolrZkClient$1$$Lambda$386/549212709.run(Unknown Source)
        at java.base@9.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
        at java.base@9.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
        at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$224/285047550.run(Unknown Source)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  14) Thread[id=9488, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-SendThread(127.0.0.1:35421), state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
  15) Thread[id=9468, name=searcherExecutor-1305-thread-1, state=WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  16) Thread[id=9489, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-EventThread, state=WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
  17) Thread[id=9520, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-EventThread, state=WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
  18) Thread[id=9550, name=zkCallback-4672-thread-4, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  19) Thread[id=9442, name=qtp209635969-9442, state=RUNNABLE, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)
        at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  20) Thread[id=9483, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  21) Thread[id=9484, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  22) Thread[id=9507, name=qtp237771039-9507, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Thread.sleep(Native Method)
        at app//org.apache.solr.cloud.ZkController.waitForShardId(ZkController.java:1562)
        at app//org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1513)
        at app//org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1622)
        at app//org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1036)
        at app//org.apache.solr.core.CoreContainer.create(CoreContainer.java:954)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
        at app//org.apache.solr.handler.admin.CoreAdminOperation$$Lambda$192/1127479847.execute(Unknown Source)
        at app//org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
        at app//org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
        at app//org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
        at app//org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:736)
        at app//org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:717)
        at app//org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:498)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
        at app//org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
        at app//org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
        at app//org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
        at app//org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
        at app//org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
        at app//org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
        at app//org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
        at app//org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
        at app//org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at app//org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
        at app//org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
        at app//org.eclipse.jetty.server.Server.handle(Server.java:534)
        at app//org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
        at app//org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
        at app//org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
        at app//org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
        at app//org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  23) Thread[id=9458, name=TEST-TestCloudSchemaless.test-seed#[E1F120F164B118E9]-EventThread, state=WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
        at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
        at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
  24) Thread[id=9548, name=zkCallback-4682-thread-5, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
        at java.base@9.0.1/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1091)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
        at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  25) Thread[id=9475, name=qtp891544163-9475-acceptor-0@5c43bc69-ServerConnector@52845991{HTTP/1.1,[http/1.1]}{127.0.0.1:45145}, state=RUNNABLE, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:424)
        at java.base@9.0.1/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:252)
        at app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371)
        at app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  26) Thread[id=9478, name=qtp891544163-9478, state=TIMED_WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
        at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
        at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2104)
        at app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  27) Thread[id=9446, name=qtp209635969-9446, state=RUNNABLE, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at java.base@9.0.1/sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:265)
        at java.base@9.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:92)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at java.base@9.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
        at app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
        at app//org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
        at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
        at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
  28) Thread[id=9461, name=Thread-476, state=WAITING, group=TGRP-TestCloudSchemaless]
        at java.base@9.0.1/java.lang.Object.wait(Native Method)
        at java.base@9.0.1/java.lang.Object.wait(Object.java:516)

[...truncated too long message...]

.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1126)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:848)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2>         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]   2>   14) Thread[id=3230, name=simCloudManagerPool-1263-thread-3, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2>         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]   2>   15) Thread[id=3236, name=simCloudManagerPool-1263-thread-8, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2>         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]   2>   16) Thread[id=3224, name=simCloudManagerPool-1263-thread-1, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2>         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]   2>   17) Thread[id=3237, name=simCloudManagerPool-1263-thread-9, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2062)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:435)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1092)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2>         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]   2>   18) Thread[id=3233, name=simCloudManagerPool-1263-thread-6, state=WAITING, group=TGRP-TestExecutePlanAction]
   [junit4]   2>         at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:871)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:903)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1226)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
   [junit4]   2>         at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.getData(SimDistribStateManager.java:396)
   [junit4]   2>         at app//org.apache.solr.client.solrj.cloud.autoscaling.DistribStateManager.getData(DistribStateManager.java:46)
   [junit4]   2>         at app//org.apache.solr.cloud.autoscaling.sim.SimClusterStateProvider.saveClusterState(SimClusterStateProvider.java:488)
   [junit4]   2>         at app//org.apache.solr.cloud.autoscaling.sim.SimClusterStateProvider.getClusterState(SimClusterStateProvider.java:1192)
   [junit4]   2>         at app//org.apache.solr.cloud.autoscaling.sim.SimClusterStateProvider.simRunLeaderElection(SimClusterStateProvider.java:519)
   [junit4]   2>         at app//org.apache.solr.cloud.autoscaling.sim.SimClusterStateProvider.access$100(SimClusterStateProvider.java:97)
   [junit4]   2>         at app//org.apache.solr.cloud.autoscaling.sim.SimClusterStateProvider$LeaderElection.call(SimClusterStateProvider.java:244)
   [junit4]   2>         at app//org.apache.solr.cloud.autoscaling.sim.SimClusterStateProvider$LeaderElection.call(SimClusterStateProvider.java:230)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2>         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2>         at app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$220/1159628320.run(Unknown Source)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2>         at java.base@9.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2>         at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=274, maxMBSortInHeap=5.652291024709633, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@59bedbad), locale=en-PK, timezone=Europe/Mariehamn
   [junit4]   2> NOTE: Linux 4.10.0-40-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=19,free=404432800,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [SpellingQueryConverterTest, CloneFieldUpdateProcessorFactoryTest, SynonymTokenizerTest, ChangedSchemaMergeTest, TestTlogReplica, ZkCLITest, TestZkAclsWithHadoopAuth, FacetPivotSmallTest, TestUseDocValuesAsStored2, TestGraphTermsQParserPlugin, TestSimDistributedQueue, SolrXmlInZkTest, TestSolrCoreSnapshots, TestCloudPseudoReturnFields, TestGraphMLResponseWriter, TestOnReconnectListenerSupport, CircularListTest, TestRangeQuery, TestPseudoReturnFields, TestAtomicUpdateErrorCases, TestLuceneMatchVersion, TestPullReplicaErrorHandling, TestHdfsBackupRestoreCore, ZkSolrClientTest, TestPayloadCheckQParserPlugin, TestXIncludeConfig, TestCollationField, ParsingFieldUpdateProcessorsTest, TestDocumentBuilder, ClusterStateUpdateTest, CloudExitableDirectoryReaderTest, SolrRequestParserTest, TestBM25SimilarityFactory, ExecutePlanActionTest, SuggesterTSTTest, TestJettySolrRunner, SolrIndexSplitterTest, TestFaceting, BadIndexSchemaTest, TestExecutePlanAction]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestExecutePlanAction -Dtests.seed=E1F120F164B118E9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-PK -Dtests.timezone=Europe/Mariehamn -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | TestExecutePlanAction (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E1F120F164B118E9]:0)
   [junit4] Completed [678/764 (3!)] on J1 in 7223.40s, 2 tests, 2 errors <<< FAILURES!

[...truncated 41039 lines...]

Mime
View raw message