lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 759 - Still Failing
Date Sat, 08 Aug 2015 22:49:43 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/759/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
	at __randomizedtesting.SeedInfo.seed([6010E055A5F18531:68709579AAFFAD3A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:465)
	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.clearSourceCollection(BaseCdcrDistributedZkTest.java:319)
	at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestReplicationStartStop(CdcrReplicationDistributedZkTest.java:147)
	at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:49)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


REGRESSION:  org.apache.solr.cloud.ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail

Error Message:
concurrent create and delete collection failed: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39074/solr: Could not fully remove collection: collection1

Stack Trace:
java.lang.AssertionError: concurrent create and delete collection failed: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39074/solr: Could not fully remove collection: collection1
	at __randomizedtesting.SeedInfo.seed([6010E055A5F18531:A139B5EFD22A5F20]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.cloud.ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail(ConcurrentDeleteAndCreateCollectionTest.java:73)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=1992, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1992, name=collection1, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:48896: Could not find collection : awholynewstresscollection_collection1_1
	at __randomizedtesting.SeedInfo.seed([6010E055A5F18531]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10448 lines...]
   [junit4] Suite: org.apache.solr.cloud.ConcurrentDeleteAndCreateCollectionTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/init-core-data-001
   [junit4]   2> 798705 INFO  (SUITE-ConcurrentDeleteAndCreateCollectionTest-seed#[6010E055A5F18531]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 798711 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testConcurrentCreateAndDeleteDoesNotFail
   [junit4]   2> 798716 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 798723 INFO  (Thread-8580) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 798723 INFO  (Thread-8580) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 798823 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.ZkTestServer start zk server on port:52874
   [junit4]   2> 798823 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 798839 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 798900 INFO  (zkCallback-1230-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6a047dad name:ZooKeeperConnection Watcher:127.0.0.1:52874 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 798900 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 798901 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 798901 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 799019 INFO  (jetty-launcher-1229-thread-1) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 799130 INFO  (jetty-launcher-1229-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@411818ec{/solr,null,AVAILABLE}
   [junit4]   2> 799148 INFO  (jetty-launcher-1229-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@76dea425{HTTP/1.1}{127.0.0.1:39074}
   [junit4]   2> 799148 INFO  (jetty-launcher-1229-thread-1) [    ] o.e.j.s.Server Started @802295ms
   [junit4]   2> 799148 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39074}
   [junit4]   2> 799149 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 799149 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/'
   [junit4]   2> 799208 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 799216 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 799219 INFO  (zkCallback-1231-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@9467a5f name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 799219 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 799219 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 799220 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 799237 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/.
   [junit4]   2> 799237 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 62287334
   [junit4]   2> 799237 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/]
   [junit4]   2> 799237 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/lib
   [junit4]   2> 799238 WARN  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/lib).
   [junit4]   2> 799303 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 799304 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 799304 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 799304 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 799305 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52874/solr
   [junit4]   2> 799305 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 799305 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 799338 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 799372 INFO  (zkCallback-1233-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3cb26230 name:ZooKeeperConnection Watcher:127.0.0.1:52874 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 799373 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 799373 INFO  (jetty-launcher-1229-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 799398 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 799401 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4af89d1c name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 799401 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 799420 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 799421 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 799484 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 799555 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 799556 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 799558 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 799559 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 799560 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 799560 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 799561 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 799562 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39074_solr
   [junit4]   2> 799562 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39074_solr
   [junit4]   2> 799563 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 799564 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 799565 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 799566 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94310907039514627-127.0.0.1:39074_solr-n_0000000000
   [junit4]   2> 799566 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39074_solr
   [junit4]   2> 799566 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 799567 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer Overseer (id=94310907039514627-127.0.0.1:39074_solr-n_0000000000) starting
   [junit4]   2> 799569 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 799573 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 799574 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 799575 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 799580 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Process current queue of overseer operations
   [junit4]   2> 799588 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 799599 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 799599 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 799601 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/.
   [junit4]   2> 799602 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.c.CoresLocator Found 0 core definitions
   [junit4]   2> 799603 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
   [junit4]   2> 799603 INFO  (jetty-launcher-1229-thread-1) [n:127.0.0.1:39074_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 799604 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 799637 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 799690 INFO  (zkCallback-1235-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@595c50ad name:ZooKeeperConnection Watcher:127.0.0.1:52874 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 799691 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 799691 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 799731 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 799753 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 799809 INFO  (zkCallback-1237-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d77badf name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 799809 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 799810 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 799816 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection0/schema.xml
   [junit4]   2> 799831 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection0/solrconfig.xml
   [junit4]   2> 799836 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 799845 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 799849 INFO  (zkCallback-1238-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@34391b11 name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 799849 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 799849 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 799850 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection1/schema.xml
   [junit4]   2> 799852 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection1/solrconfig.xml
   [junit4]   2> 799866 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 799948 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 799965 INFO  (zkCallback-1239-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@625d34e name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 799965 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800035 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800035 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection2/schema.xml
   [junit4]   2> 800038 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection2/solrconfig.xml
   [junit4]   2> 800041 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 800066 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 800073 INFO  (zkCallback-1240-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@39abedf9 name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 800073 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800073 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800074 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection3/schema.xml
   [junit4]   2> 800076 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection3/solrconfig.xml
   [junit4]   2> 800079 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 800093 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 800101 INFO  (zkCallback-1241-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@36cce44e name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 800101 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800101 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800102 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection4/schema.xml
   [junit4]   2> 800104 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection4/solrconfig.xml
   [junit4]   2> 800106 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 800121 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 800121 INFO  (zkCallback-1242-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@26ead918 name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 800121 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800122 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800122 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection5/schema.xml
   [junit4]   2> 800124 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection5/solrconfig.xml
   [junit4]   2> 800216 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 800246 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 800289 INFO  (zkCallback-1243-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@249f72b6 name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 800292 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800292 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800293 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection6/schema.xml
   [junit4]   2> 800301 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection6/solrconfig.xml
   [junit4]   2> 800304 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 800312 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 800320 INFO  (zkCallback-1244-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1ab57a12 name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 800321 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800321 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800322 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection7/schema.xml
   [junit4]   2> 800324 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection7/solrconfig.xml
   [junit4]   2> 800328 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 800338 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 800359 INFO  (zkCallback-1245-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@89ee702 name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 800359 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800359 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800360 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection8/schema.xml
   [junit4]   2> 800362 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection8/solrconfig.xml
   [junit4]   2> 800387 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 800389 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 800390 INFO  (zkCallback-1246-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ca5171d name:ZooKeeperConnection Watcher:127.0.0.1:52874/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 800390 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 800390 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 800391 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection9/schema.xml
   [junit4]   2> 800393 INFO  (TEST-ConcurrentDeleteAndCreateCollectionTest.testConcurrentCreateAndDeleteDoesNotFail-seed#[6010E055A5F18531]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/collection9/solrconfig.xml
   [junit4]   2> 800444 INFO  (qtp1300493559-12411) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection9&name=collection9&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800444 INFO  (qtp1300493559-12412) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection5&name=collection5&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800445 INFO  (qtp1300493559-12409) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection1&name=collection1&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800445 INFO  (qtp1300493559-12410) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection7&name=collection7&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800543 INFO  (qtp1300493559-12413) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection0&name=collection0&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800544 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
   [junit4]   2> 800547 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>   "name":"collection9",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection9",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800569 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000001 message:{
   [junit4]   2>   "name":"collection5",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection5",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800570 WARN  (OverseerThreadFactory-1950-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection9",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection9",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800574 INFO  (OverseerThreadFactory-1950-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection9 
   [junit4]   2> 800575 INFO  (OverseerThreadFactory-1950-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection9
   [junit4]   2> 800581 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800581 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"collection9",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection9",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 0
   [junit4]   2> 800581 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection9
   [junit4]   2> 800584 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection9/state.json
   [junit4]   2> 800584 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800601 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800602 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000003 message:{
   [junit4]   2>   "name":"collection7",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection7",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800602 WARN  (OverseerThreadFactory-1950-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800642 INFO  (qtp1300493559-12475) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection2&name=collection2&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800622 WARN  (OverseerThreadFactory-1950-thread-4-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection7",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection7",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800622 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000004 message:{
   [junit4]   2>   "name":"collection0",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection0",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800602 WARN  (OverseerThreadFactory-1950-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection5",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection5",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800654 INFO  (OverseerThreadFactory-1950-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection1 
   [junit4]   2> 800655 INFO  (OverseerThreadFactory-1950-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 800660 INFO  (OverseerThreadFactory-1950-thread-4-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection7 
   [junit4]   2> 800661 INFO  (OverseerThreadFactory-1950-thread-4-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection7
   [junit4]   2> 800670 INFO  (OverseerThreadFactory-1950-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection5 
   [junit4]   2> 800674 INFO  (OverseerThreadFactory-1950-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection5
   [junit4]   2> 800681 INFO  (OverseerThreadFactory-1950-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection collection9, shardNames [shard1] , replicationFactor : 1
   [junit4]   2> 800681 INFO  (OverseerThreadFactory-1950-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core collection9_shard1_replica1 as part of shard shard1 of collection collection9 on 127.0.0.1:39074_solr
   [junit4]   2> 800738 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800739 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800742 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection1",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 1
   [junit4]   2> 800742 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 800743 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800744 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "name":"collection7",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection7",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 1
   [junit4]   2> 800744 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection7
   [junit4]   2> 800744 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 800745 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800748 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "name":"collection5",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection5",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 2
   [junit4]   2> 800748 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection5
   [junit4]   2> 800749 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection7/state.json
   [junit4]   2> 800752 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection5/state.json
   [junit4]   2> 800761 INFO  (OverseerThreadFactory-1950-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection collection1, shardNames [shard1] , replicationFactor : 1
   [junit4]   2> 800762 INFO  (OverseerThreadFactory-1950-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core collection1_shard1_replica1 as part of shard shard1 of collection collection1 on 127.0.0.1:39074_solr
   [junit4]   2> 800779 WARN  (OverseerThreadFactory-1950-thread-5-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection0",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection0",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800781 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000010 message:{
   [junit4]   2>   "name":"collection2",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection2",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800783 INFO  (OverseerThreadFactory-1950-thread-4-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection collection7, shardNames [shard1] , replicationFactor : 1
   [junit4]   2> 800783 INFO  (OverseerThreadFactory-1950-thread-4-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core collection7_shard1_replica1 as part of shard shard1 of collection collection7 on 127.0.0.1:39074_solr
   [junit4]   2> 800786 INFO  (OverseerThreadFactory-1950-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection collection5, shardNames [shard1] , replicationFactor : 1
   [junit4]   2> 800786 INFO  (OverseerThreadFactory-1950-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core collection5_shard1_replica1 as part of shard shard1 of collection collection5 on 127.0.0.1:39074_solr
   [junit4]   2> 800794 INFO  (OverseerThreadFactory-1950-thread-5-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection0 
   [junit4]   2> 800795 INFO  (OverseerThreadFactory-1950-thread-5-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection0
   [junit4]   2> 800796 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800796 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800796 INFO  (zkCallback-1234-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800809 INFO  (qtp1300493559-12480) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection6&name=collection6&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800811 WARN  (OverseerThreadFactory-1950-thread-6-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection2",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection2",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800814 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
   [junit4]   2> 800814 INFO  (OverseerThreadFactory-1950-thread-6-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection2 
   [junit4]   2> 800814 INFO  (OverseerThreadFactory-1950-thread-6-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection2
   [junit4]   2> 800815 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000012 message:{
   [junit4]   2>   "name":"collection6",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection6",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800815 WARN  (OverseerThreadFactory-1950-thread-7-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection6",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection6",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800818 INFO  (zkCallback-1234-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800819 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "name":"collection0",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection0",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 4
   [junit4]   2> 800819 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection0
   [junit4]   2> 800820 INFO  (OverseerThreadFactory-1950-thread-7-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection6 
   [junit4]   2> 800821 INFO  (OverseerThreadFactory-1950-thread-7-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection6
   [junit4]   2> 800822 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"collection2",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection2",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 4
   [junit4]   2> 800822 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection2
   [junit4]   2> 800823 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection0/state.json
   [junit4]   2> 800824 INFO  (zkCallback-1234-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800824 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800827 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800830 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "name":"collection6",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection6",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"} current state version: 5
   [junit4]   2> 800830 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection6
   [junit4]   2> 800831 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection2/state.json
   [junit4]   2> 800832 INFO  (zkCallback-1234-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800832 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800833 INFO  (qtp1300493559-12486) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection3&name=collection3&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800833 INFO  (qtp1300493559-12491) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection8&name=collection8&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800835 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
   [junit4]   2> 800840 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000014 message:{
   [junit4]   2>   "name":"collection3",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection3",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800841 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800842 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection6/state.json
   [junit4]   2> 800843 INFO  (zkCallback-1234-thread-1-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800843 INFO  (zkCallback-1234-thread-3-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800844 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000015 message:{
   [junit4]   2>   "name":"collection8",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection8",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800844 WARN  (OverseerThreadFactory-1950-thread-8-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection3",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection3",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800845 INFO  (qtp1300493559-12492) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=collection4&name=collection4&action=CREATE&numShards=1&wt=javabin&version=2 
   [junit4]   2> 800853 WARN  (OverseerThreadFactory-1950-thread-9-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection8",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection8",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800864 INFO  (qtp1300493559-12493) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=collection9&name=collection9_shard1_replica1&action=CREATE&numShards=1&collection=collection9&shard=shard1&wt=javabin&version=2
   [junit4]   2> 800867 INFO  (qtp1300493559-12493) [n:127.0.0.1:39074_solr    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection9_shard1_replica1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection9_shard1_replica1, collection=collection9, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/./collection9_shard1_replica1/, numShards=1, dataDir=data/, shard=shard1}
   [junit4]   2> 800871 INFO  (qtp1300493559-12496) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=collection1&name=collection1_shard1_replica1&action=CREATE&numShards=1&collection=collection1&shard=shard1&wt=javabin&version=2
   [junit4]   2> 800872 INFO  (qtp1300493559-12496) [n:127.0.0.1:39074_solr    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1_shard1_replica1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection1_shard1_replica1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/./collection1_shard1_replica1/, numShards=1, dataDir=data/, shard=shard1}
   [junit4]   2> 800882 INFO  (qtp1300493559-12497) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=collection5&name=collection5_shard1_replica1&action=CREATE&numShards=1&collection=collection5&shard=shard1&wt=javabin&version=2
   [junit4]   2> 800882 INFO  (qtp1300493559-12497) [n:127.0.0.1:39074_solr    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection5_shard1_replica1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection5_shard1_replica1, collection=collection5, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/./collection5_shard1_replica1/, numShards=1, dataDir=data/, shard=shard1}
   [junit4]   2> 800889 INFO  (qtp1300493559-12498) [n:127.0.0.1:39074_solr    ] o.a.s.h.a.CoreAdminHandler core create command qt=/admin/cores&collection.configName=collection7&name=collection7_shard1_replica1&action=CREATE&numShards=1&collection=collection7&shard=shard1&wt=javabin&version=2
   [junit4]   2> 800889 INFO  (qtp1300493559-12498) [n:127.0.0.1:39074_solr    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection7_shard1_replica1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection7_shard1_replica1, collection=collection7, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ConcurrentDeleteAndCreateCollectionTest_6010E055A5F18531-001/tempDir-001/./collection7_shard1_replica1/, numShards=1, dataDir=data/, shard=shard1}
   [junit4]   2> 800895 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/collection-queue-work state SyncConnected
   [junit4]   2> 800900 INFO  (OverseerThreadFactory-1950-thread-5-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection collection0, shardNames [shard1] , replicationFactor : 1
   [junit4]   2> 800900 INFO  (OverseerThreadFactory-1950-thread-5-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core collection0_shard1_replica1 as part of shard shard1 of collection collection0 on 127.0.0.1:39074_solr
   [junit4]   2> 800915 INFO  (qtp1300493559-12498) [n:127.0.0.1:39074_solr c:collection7 s:shard1  x:collection7_shard1_replica1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 800917 INFO  (qtp1300493559-12497) [n:127.0.0.1:39074_solr c:collection5 s:shard1  x:collection5_shard1_replica1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 800917 INFO  (qtp1300493559-12496) [n:127.0.0.1:39074_solr c:collection1 s:shard1  x:collection1_shard1_replica1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 800918 INFO  (qtp1300493559-12493) [n:127.0.0.1:39074_solr c:collection9 s:shard1  x:collection9_shard1_replica1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 800921 INFO  (OverseerThreadFactory-1950-thread-6-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection collection2, shardNames [shard1] , replicationFactor : 1
   [junit4]   2> 800922 INFO  (OverseerThreadFactory-1950-thread-6-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler Creating core collection2_shard1_replica1 as part of shard shard1 of collection collection2 on 127.0.0.1:39074_solr
   [junit4]   2> 800924 INFO  (OverseerCollectionProcessor-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerProcessor Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000018 message:{
   [junit4]   2>   "name":"collection4",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection4",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800941 INFO  (qtp1300493559-12498) [n:127.0.0.1:39074_solr c:collection7 s:shard1  x:collection7_shard1_replica1] o.a.s.c.ZkController Registering watch for collection collection7
   [junit4]   2> 800941 INFO  (qtp1300493559-12498) [n:127.0.0.1:39074_solr c:collection7 s:shard1  x:collection7_shard1_replica1] o.a.s.c.c.ZkStateReader addZkWatch collection7
   [junit4]   2> 800942 INFO  (qtp1300493559-12497) [n:127.0.0.1:39074_solr c:collection5 s:shard1  x:collection5_shard1_replica1] o.a.s.c.ZkController Registering watch for collection collection5
   [junit4]   2> 800942 INFO  (qtp1300493559-12497) [n:127.0.0.1:39074_solr c:collection5 s:shard1  x:collection5_shard1_replica1] o.a.s.c.c.ZkStateReader addZkWatch collection5
   [junit4]   2> 800944 INFO  (qtp1300493559-12496) [n:127.0.0.1:39074_solr c:collection1 s:shard1  x:collection1_shard1_replica1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 800945 INFO  (qtp1300493559-12496) [n:127.0.0.1:39074_solr c:collection1 s:shard1  x:collection1_shard1_replica1] o.a.s.c.c.ZkStateReader addZkWatch collection1
   [junit4]   2> 800945 INFO  (qtp1300493559-12493) [n:127.0.0.1:39074_solr c:collection9 s:shard1  x:collection9_shard1_replica1] o.a.s.c.ZkController Registering watch for collection collection9
   [junit4]   2> 800945 INFO  (qtp1300493559-12493) [n:127.0.0.1:39074_solr c:collection9 s:shard1  x:collection9_shard1_replica1] o.a.s.c.c.ZkStateReader addZkWatch collection9
   [junit4]   2> 800946 INFO  (qtp1300493559-12498) [n:127.0.0.1:39074_solr c:collection7 s:shard1  x:collection7_shard1_replica1] o.a.s.c.c.ZkStateReader Updating data for collection7 to ver 0 
   [junit4]   2> 800946 INFO  (qtp1300493559-12497) [n:127.0.0.1:39074_solr c:collection5 s:shard1  x:collection5_shard1_replica1] o.a.s.c.c.ZkStateReader Updating data for collection5 to ver 0 
   [junit4]   2> 800946 INFO  (qtp1300493559-12496) [n:127.0.0.1:39074_solr c:collection1 s:shard1  x:collection1_shard1_replica1] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0 
   [junit4]   2> 800946 INFO  (qtp1300493559-12493) [n:127.0.0.1:39074_solr c:collection9 s:shard1  x:collection9_shard1_replica1] o.a.s.c.c.ZkStateReader Updating data for collection9 to ver 0 
   [junit4]   2> 800947 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
   [junit4]   2>   "core":"collection7_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39074/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39074_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection7",
   [junit4]   2>   "operation":"state"} current state version: 7
   [junit4]   2> 800948 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection7_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39074/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39074_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection7",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 800948 INFO  (qtp1300493559-12493) [n:127.0.0.1:39074_solr c:collection9 s:shard1  x:collection9_shard1_replica1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 800949 INFO  (qtp1300493559-12496) [n:127.0.0.1:39074_solr c:collection1 s:shard1  x:collection1_shard1_replica1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 800949 INFO  (qtp1300493559-12498) [n:127.0.0.1:39074_solr c:collection7 s:shard1  x:collection7_shard1_replica1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 800949 INFO  (qtp1300493559-12497) [n:127.0.0.1:39074_solr c:collection5 s:shard1  x:collection5_shard1_replica1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 800954 INFO  (OverseerThreadFactory-1950-thread-9-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0 
   [junit4]   2> 800954 INFO  (OverseerThreadFactory-1950-thread-8-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection3 
   [junit4]   2> 800955 INFO  (OverseerThreadFactory-1950-thread-9-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection5 to ver 0 
   [junit4]   2> 800956 INFO  (OverseerThreadFactory-1950-thread-8-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection3
   [junit4]   2> 800957 INFO  (OverseerThreadFactory-1950-thread-9-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection7 to ver 0 
   [junit4]   2> 800958 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 800960 INFO  (OverseerThreadFactory-1950-thread-9-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection9 to ver 0 
   [junit4]   2> 800961 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
   [junit4]   2>   "core":"collection5_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39074/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39074_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection5",
   [junit4]   2>   "operation":"state"} current state version: 7
   [junit4]   2> 800969 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection5_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39074/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39074_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection5",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 800971 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection7/state.json version: 0
   [junit4]   2> 800973 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection7/state.json for collection collection7 has occurred - updating... (live nodes size: 1)
   [junit4]   2> 800977 INFO  (zkCallback-1234-thread-2-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection7 to ver 1 
   [junit4]   2> 800979 INFO  (OverseerThreadFactory-1950-thread-9-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/collection8 
   [junit4]   2> 800981 INFO  (OverseerThreadFactory-1950-thread-9-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection8
   [junit4]   2> 800985 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
   [junit4]   2>   "core":"collection1_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39074/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39074_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 7
   [junit4]   2> 800986 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39074/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39074_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 800987 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection5/state.json version: 0
   [junit4]   2> 800992 WARN  (OverseerThreadFactory-1950-thread-10-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>   "name":"collection4",
   [junit4]   2>   "fromApi":"true",
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "collection.configName":"collection4",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "stateFormat":"2",
   [junit4]   2>   "operation":"create"}
   [junit4]   2> 800998 INFO  (OverseerThreadFactory-1950-thread-10-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0 
   [junit4]   2> 801005 INFO  (OverseerThreadFactory-1950-thread-10-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection5 to ver 1 
   [junit4]   2> 801006 INFO  (OverseerThreadFactory-1950-thread-10-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection7 to ver 1 
   [junit4]   2> 801007 INFO  (OverseerThreadFactory-1950-thread-10-processing-n:127.0.0.1:39074_solr) [n:127.0.0.1:39074_solr    ] o.a.s.c.c.ZkStateReader Updating data for collection9 to ver 0 
   [junit4]   2> 801007 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.Overseer processMessage: queueSize: 4, message = {
   [junit4]   2>   "core":"collection9_shard1_replica1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:39074/solr",
   [junit4]   2>   "node_name":"127.0.0.1:39074_solr",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"collection9",
   [junit4]   2>   "operation":"state"} current state version: 7
   [junit4]   2> 801013 INFO  (OverseerStateUpdate-94310907039514627-127.0.0.1:39074_solr-n_0000000000) [n:127.0.0.1:39074_solr    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection9_shard1_replica1",
   [junit4]   2>  

[...truncated too long message...]

unit4]   2> 3002340 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[6010E055A5F18531]) [n:127.0.0.1:41528_ c:source_collection s:shard1 r:core_node2 x:source_collection_shard1_replica2] o.a.s.c.Overseer Overseer (id=94311013076631583-127.0.0.1:44612_-n_0000000007) closing
   [junit4]   2> 3002340 INFO  (OverseerStateUpdate-94311013076631583-127.0.0.1:44612_-n_0000000007) [n:127.0.0.1:44612_    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44612_
   [junit4]   2> 3002343 INFO  (zkCallback-1187-thread-4-processing-n:127.0.0.1:44612_) [n:127.0.0.1:44612_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3002343 WARN  (zkCallback-1187-thread-4-processing-n:127.0.0.1:44612_) [n:127.0.0.1:44612_    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 3002346 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[6010E055A5F18531]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@4cb67898{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 3002346 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[6010E055A5F18531]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@24735d2f{/,null,UNAVAILABLE}
   [junit4]   2> 3002347 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[6010E055A5F18531]) [n:127.0.0.1:41528_ c:source_collection s:shard1 r:core_node2 x:source_collection_shard1_replica2] o.a.s.SolrTestCaseJ4 ###Ending doTests
   [junit4]   2> 3002352 INFO  (TEST-CdcrReplicationDistributedZkTest.doTests-seed#[6010E055A5F18531]) [n:127.0.0.1:41528_ c:source_collection s:shard1 r:core_node2 x:source_collection_shard1_replica2] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49810 49810
   [junit4]   2> 3002489 INFO  (Thread-5819) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49810 49810
   [junit4]   2> 3002494 WARN  (Thread-5819) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	81	/solr/aliases.json
   [junit4]   2> 	45	/solr/configs/conf1
   [junit4]   2> 	11	/solr/security.json
   [junit4]   2> 	2	/solr/collections/source_collection/leaders/shard1
   [junit4]   2> 	2	/solr/collections/source_collection/leaders/shard2
   [junit4]   2> 	2	/solr/collections/tmp_collection/leaders/shard1
   [junit4]   2> 	2	/solr/collections/tmp_collection/leaders/shard2
   [junit4]   2> 	2	/solr/collections/target_collection/leaders/shard1
   [junit4]   2> 	2	/solr/collections/target_collection/leaders/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	123	/solr/clusterstate.json
   [junit4]   2> 	21	/solr/collections/source_collection/cdcr/state/process
   [junit4]   2> 	20	/solr/collections/source_collection/cdcr/state/buffer
   [junit4]   2> 	17	/solr/collections/target_collection/cdcr/state/buffer
   [junit4]   2> 	17	/solr/collections/target_collection/cdcr/state/process
   [junit4]   2> 	8	/solr/collections/tmp_collection/cdcr/state/process
   [junit4]   2> 	8	/solr/collections/tmp_collection/cdcr/state/buffer
   [junit4]   2> 	5	/solr/collections/source_collection/state.json
   [junit4]   2> 	5	/solr/collections/target_collection/state.json
   [junit4]   2> 	3	/solr/collections/source_collection/leader_elect/shard1/election/94311013076631559-core_node1-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/94311013076631574-127.0.0.1:58686_-n_0000000004
   [junit4]   2> 	2	/solr/overseer_elect/election/94311013076631559-127.0.0.1:35272_-n_0000000001
   [junit4]   2> 	2	/solr/overseer_elect/election/94311013076631583-127.0.0.1:44612_-n_0000000007
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	90	/solr/live_nodes
   [junit4]   2> 	6	/solr/overseer/queue
   [junit4]   2> 	6	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CdcrReplicationDistributedZkTest -Dtests.method=doTests -Dtests.seed=6010E055A5F18531 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ro -Dtests.timezone=America/Costa_Rica -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE  586s J2 | CdcrReplicationDistributedZkTest.doTests <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6010E055A5F18531:68709579AAFFAD3A]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
   [junit4]    > 	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:465)
   [junit4]    > 	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.clearSourceCollection(BaseCdcrDistributedZkTest.java:319)
   [junit4]    > 	at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestReplicationStartStop(CdcrReplicationDistributedZkTest.java:147)
   [junit4]    > 	at org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:49)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 3002511 INFO  (SUITE-CdcrReplicationDistributedZkTest-seed#[6010E055A5F18531]-worker) [n:127.0.0.1:41528_ c:source_collection s:shard1 r:core_node2 x:source_collection_shard1_replica2] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CdcrReplicationDistributedZkTest_6010E055A5F18531-001
   [junit4]   2> Aug 08, 2015 6:20:40 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {_version_=Lucene50(blocksize=128), id=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{}, sim=DefaultSimilarity, locale=ro, timezone=America/Costa_Rica
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=1,free=259677784,total=530579456
   [junit4]   2> NOTE: All tests run in this JVM: [TestCustomSort, TestNamedUpdateProcessors, IgnoreCommitOptimizeUpdateProcessorFactoryTest, FullHLLTest, BadIndexSchemaTest, TestMiniSolrCloudCluster, HdfsCollectionsAPIDistributedZkTest, SharedFSAutoReplicaFailoverTest, TestNRTOpen, EnumFieldTest, TestSolrJ, TestRandomMergePolicy, TestSolrCLIRunExample, TestTrie, DOMUtilTest, CloudExitableDirectoryReaderTest, TestDistribIDF, TestNonDefinedSimilarityFactory, CursorPagingTest, DocValuesTest, TestBulkSchemaAPI, TestClusterStateMutator, QueryEqualityTest, TestShortCircuitedRequests, CustomCollectionTest, SimpleFacetsTest, TestManagedSchema, OverseerTest, XsltUpdateRequestHandlerTest, ExitableDirectoryReaderTest, ExplicitHLLTest, DistributedDebugComponentTest, DistributedQueryComponentCustomSortTest, TestReload, AddBlockUpdateTest, TestSmileRequest, TestFastOutputStream, TestRecovery, OverseerStatusTest, BitVectorTest, OpenExchangeRatesOrgProviderTest, UnloadDistributedZkTest, AutoCommitTest, TestReplicationHandlerBackup, DirectUpdateHandlerTest, AnalyticsMergeStrategyTest, TestUtils, OverseerCollectionProcessorTest, HdfsDirectoryTest, TestBM25SimilarityFactory, BJQParserTest, PluginInfoTest, ResponseHeaderTest, TestSerializedLuceneMatchVersion, BasicDistributedZk2Test, HdfsNNFailoverTest, FileBasedSpellCheckerTest, CdcrReplicationDistributedZkTest]
   [junit4] Completed [349/539] on J2 in 586.40s, 1 test, 1 failure <<< FAILURES!

[...truncated 629 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:723: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:660: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:230: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1429: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:984: There were test failures: 539 suites, 2126 tests, 1 error, 2 failures, 26 ignored (14 assumptions)

Total time: 207 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message