lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 774 - Still Failing
Date Mon, 24 Aug 2015 12:16:54 GMT
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/774/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=17888, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=17888, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:34691, http://127.0.0.1:46838, http://127.0.0.1:43095, http://127.0.0.1:48099, http://127.0.0.1:47081]
	at __randomizedtesting.SeedInfo.seed([16065656F6904182]:0)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:898)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:34691, http://127.0.0.1:46838, http://127.0.0.1:43095, http://127.0.0.1:48099, http://127.0.0.1:47081]
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34691: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	... 5 more


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=29644, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=29644, name=collection3, state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35116: Could not find collection : awholynewstresscollection_collection3_0
	at __randomizedtesting.SeedInfo.seed([16065656F6904182]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10519 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/init-core-data-001
   [junit4]   2> 1465543 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[16065656F6904182]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1465544 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[16065656F6904182]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1465546 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1465548 INFO  (Thread-10418) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1465548 INFO  (Thread-10418) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1465648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.ZkTestServer start zk server on port:34373
   [junit4]   2> 1465648 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1465649 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1465651 INFO  (zkCallback-1608-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f1f9717 name:ZooKeeperConnection Watcher:127.0.0.1:34373 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1465652 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1465652 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1465652 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1465655 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1465655 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1465656 INFO  (zkCallback-1609-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@708a6bc4 name:ZooKeeperConnection Watcher:127.0.0.1:34373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1465657 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1465657 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1465657 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1465658 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1465660 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1465661 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1465662 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1465662 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1465665 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1465665 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1465667 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1465667 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1465668 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1465669 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1465670 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1465670 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1465672 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1465672 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1465673 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1465674 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1465675 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1465675 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1465677 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1465677 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1465678 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1465679 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1465680 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1465680 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1465998 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1
   [junit4]   2> 1466000 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1466002 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f076427{/,null,AVAILABLE}
   [junit4]   2> 1466003 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.ServerConnector Started ServerConnector@4ed44f30{HTTP/1.1}{127.0.0.1:46838}
   [junit4]   2> 1466003 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.Server Started @1469292ms
   [junit4]   2> 1466003 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/tempDir-001/control/data, hostContext=/, hostPort=46838, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores}
   [junit4]   2> 1466004 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1466004 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/'
   [junit4]   2> 1466019 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1466020 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1466021 INFO  (zkCallback-1610-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10dcaf4f name:ZooKeeperConnection Watcher:127.0.0.1:34373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1466021 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1466022 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1466023 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1466023 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/solr.xml
   [junit4]   2> 1466028 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores
   [junit4]   2> 1466028 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoreContainer New CoreContainer 614240466
   [junit4]   2> 1466028 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/]
   [junit4]   2> 1466029 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/lib
   [junit4]   2> 1466029 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/lib).
   [junit4]   2> 1466036 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1466037 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1466037 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1466038 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1466038 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34373/solr
   [junit4]   2> 1466038 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1466038 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1466039 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1466040 INFO  (zkCallback-1612-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@371ed0cd name:ZooKeeperConnection Watcher:127.0.0.1:34373 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1466041 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1466041 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1466043 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1466044 INFO  (zkCallback-1613-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66b8e512 name:ZooKeeperConnection Watcher:127.0.0.1:34373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1466044 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1466045 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1466048 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1466051 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1466054 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1466056 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1466058 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1466059 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1466061 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1466062 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1466063 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46838_
   [junit4]   2> 1466064 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:46838_
   [junit4]   2> 1466065 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1466066 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1466068 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1466068 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94399083377917956-127.0.0.1:46838_-n_0000000000
   [junit4]   2> 1466069 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46838_
   [junit4]   2> 1466069 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1466071 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer Overseer (id=94399083377917956-127.0.0.1:46838_-n_0000000000) starting
   [junit4]   2> 1466073 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1466080 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1466080 INFO  (OverseerCollectionProcessor-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.OverseerProcessor Process current queue of overseer operations
   [junit4]   2> 1466080 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1466081 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1466094 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1466094 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1466095 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores
   [junit4]   2> 1466096 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1466096 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/
   [junit4]   2> 1466096 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1466097 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1466097 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1466097 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:46838_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1466097 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1466098 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1466099 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:46838",
   [junit4]   2>   "node_name":"127.0.0.1:46838_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1466100 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:46838",
   [junit4]   2>   "node_name":"127.0.0.1:46838_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1466100 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1466101 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1466103 INFO  (zkCallback-1613-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1467099 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1467099 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1467099 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1467099 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1467100 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1467100 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/'
   [junit4]   2> 1467113 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1467118 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1467121 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1467129 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1467130 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1467134 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1467238 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1467244 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1467245 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1467253 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1467255 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1467257 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1467257 WARN  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1467258 WARN  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1467258 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1467259 WARN  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1467259 WARN  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1467260 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1467260 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1467260 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1467260 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1467260 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f0adbc3
   [junit4]   2> 1467261 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/data
   [junit4]   2> 1467261 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1467261 WARN  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1467261 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/data/index
   [junit4]   2> 1467262 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8274339856619107]
   [junit4]   2> 1467262 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@7490aa41 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c0e2b3c),segFN=segments_1,generation=1}
   [junit4]   2> 1467262 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1467266 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1467267 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1467267 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1467267 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1467267 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1467267 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1467267 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1467268 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1467268 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1467270 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1467271 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1467272 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1467272 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/data/
   [junit4]   2> 1467273 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1467273 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1467276 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1467277 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1467277 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1467277 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1467278 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1467278 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1467278 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=92.26171875, floorSegmentMB=0.6337890625, forceMergeDeletesPctAllowed=22.426698914779777, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1467279 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@7490aa41 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c0e2b3c),segFN=segments_1,generation=1}
   [junit4]   2> 1467279 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1467279 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@2fc86544[collection1] main
   [junit4]   2> 1467279 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1467280 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1467280 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1467281 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1467281 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1467281 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1467281 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1467281 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1467281 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1467282 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1467282 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1467282 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1467282 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1467282 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1510385335863869440
   [junit4]   2> 1467284 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1510385335863869440
   [junit4]   2> 1467285 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1467285 INFO  (coreLoadExecutor-4406-thread-1-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1467288 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:46838 collection:control_collection shard:shard1
   [junit4]   2> 1467288 INFO  (searcherExecutor-4407-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2fc86544[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1467292 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1467295 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94399083377917956-core_node1-n_0000000000
   [junit4]   2> 1467300 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1467301 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1467301 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1467302 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46838/collection1/
   [junit4]   2> 1467302 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1467302 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1467303 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:46838/collection1/ has no replicas
   [junit4]   2> 1467303 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46838/collection1/ shard1
   [junit4]   2> 1467303 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1467306 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:46838",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1467408 INFO  (zkCallback-1613-thread-2-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1467457 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:46838/collection1/ and leader is http://127.0.0.1:46838/collection1/
   [junit4]   2> 1467457 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:46838
   [junit4]   2> 1467458 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1467458 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1467458 INFO  (coreZkRegister-4400-thread-1-processing-n:127.0.0.1:46838_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:46838_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1467459 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:46838",
   [junit4]   2>   "node_name":"127.0.0.1:46838_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1467460 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:46838",
   [junit4]   2>   "node_name":"127.0.0.1:46838_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1467562 INFO  (zkCallback-1613-thread-2-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1467599 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1467600 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1467601 INFO  (zkCallback-1615-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d596ea1 name:ZooKeeperConnection Watcher:127.0.0.1:34373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1467601 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1467601 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1467601 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1467603 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1467911 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1
   [junit4]   2> 1467912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001
   [junit4]   2> 1467912 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1467914 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@546231a6{/,null,AVAILABLE}
   [junit4]   2> 1467914 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.ServerConnector Started ServerConnector@249b9e66{HTTP/1.1}{127.0.0.1:34691}
   [junit4]   2> 1467915 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.e.j.s.Server Started @1471203ms
   [junit4]   2> 1467915 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=34691, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores}
   [junit4]   2> 1467915 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1467915 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/'
   [junit4]   2> 1467930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1467930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1467932 INFO  (zkCallback-1616-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5870249d name:ZooKeeperConnection Watcher:127.0.0.1:34373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1467932 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1467933 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1467934 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1467934 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/solr.xml
   [junit4]   2> 1467942 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores
   [junit4]   2> 1467942 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoreContainer New CoreContainer 1585019683
   [junit4]   2> 1467943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/]
   [junit4]   2> 1467943 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.CoreContainer loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/lib
   [junit4]   2> 1467943 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/lib).
   [junit4]   2> 1467950 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1467951 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1467952 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1467952 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1467952 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34373/solr
   [junit4]   2> 1467952 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1467952 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1467953 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1467954 INFO  (zkCallback-1618-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@493ceada name:ZooKeeperConnection Watcher:127.0.0.1:34373 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1467955 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1467955 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1467958 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1467959 INFO  (zkCallback-1619-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3076cdba name:ZooKeeperConnection Watcher:127.0.0.1:34373/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1467959 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1467966 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1468972 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34691_
   [junit4]   2> 1468973 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:34691_
   [junit4]   2> 1468974 INFO  (zkCallback-1615-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1468974 INFO  (zkCallback-1619-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1468974 INFO  (zkCallback-1613-thread-2-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1468976 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1468977 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94399083377917960-127.0.0.1:34691_-n_0000000001
   [junit4]   2> 1468978 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94399083377917956-127.0.0.1:46838_-n_0000000000 to know if I could be the leader
   [junit4]   2> 1468989 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1468989 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1468989 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores
   [junit4]   2> 1468990 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1468991 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.CoresLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/
   [junit4]   2> 1468991 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1468992 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1468992 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1468992 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1468992 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[16065656F6904182]) [n:127.0.0.1:34691_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1468992 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1468993 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:34691",
   [junit4]   2>   "node_name":"127.0.0.1:34691_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 1468994 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:34691",
   [junit4]   2>   "node_name":"127.0.0.1:34691_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1468994 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1468995 INFO  (OverseerStateUpdate-94399083377917956-127.0.0.1:46838_-n_0000000000) [n:127.0.0.1:46838_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1469098 INFO  (zkCallback-1615-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1469098 INFO  (zkCallback-1619-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1469098 INFO  (zkCallback-1613-thread-2-processing-n:127.0.0.1:46838_) [n:127.0.0.1:46838_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1469993 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1469993 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 1469994 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1469994 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
   [junit4]   2> 1469994 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1469994 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/'
   [junit4]   2> 1470008 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1470012 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1470016 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1470023 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1470024 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1470028 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1470120 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1470125 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1470126 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1470133 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1470136 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1470138 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1470139 WARN  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1470139 WARN  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1470139 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1470140 WARN  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1470140 WARN  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1470141 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 1470141 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1470141 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1470141 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1470142 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f0adbc3
   [junit4]   2> 1470142 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/data
   [junit4]   2> 1470142 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/data/index/
   [junit4]   2> 1470142 WARN  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1470143 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_16065656F6904182-001/shard-1-001/cores/collection1/data/index
   [junit4]   2> 1470143 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8274339856619107]
   [junit4]   2> 1470144 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@513039a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@57c5cd07),segFN=segments_1,generation=1}
   [junit4]   2> 1470144 INFO  (coreLoadExecutor-4417-thread-1-processing-n:127.0.0.1:34691_) [n:127.0.0.1:34691_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
 

[...truncated too long message...]

813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:197)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.teardownClass(HdfsCollectionsAPIDistributedZkTest.java:50)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 3633548 INFO  (SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[16065656F6904182]-worker) [n:127.0.0.1:35116_ c:addReplicaColl s:shard1 r:core_node7 x:propertyDotName] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Aug 24, 2015 8:04:29 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {other_tl1=Lucene50(blocksize=128), range_facet_l_dv=PostingsFormat(name=Asserting), _version_=Lucene50(blocksize=128), multiDefault=FST50, a_t=FST50, intDefault=Lucene50(blocksize=128), a_i1=FST50, id=PostingsFormat(name=Asserting), range_facet_i_dv=FST50, text=BlockTreeOrds(blocksize=128), range_facet_l=FST50, timestamp=FST50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=sk, timezone=Asia/Baghdad
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=4,threads=2,free=85812800,total=529006592
   [junit4]   2> NOTE: All tests run in this JVM: [FileBasedSpellCheckerTest, DirectSolrSpellCheckerTest, TestHighFrequencyDictionaryFactory, TestGroupingSearch, DistributedExpandComponentTest, TestCloudInspectUtil, ZkStateWriterTest, TestSolrConfigHandlerConcurrent, HdfsUnloadDistributedZkTest, TestSimpleQParserPlugin, TestStressRecovery, TestExpandComponent, HdfsBasicDistributedZk2Test, TestSolrCloudWithKerberosAlt, ResponseLogComponentTest, SmileWriterTest, HdfsThreadLeakTest, PathHierarchyTokenizerFactoryTest, BitVectorTest, DistributedFacetPivotWhiteBoxTest, DataDrivenBlockJoinTest, SampleTest, TestReloadAndDeleteDocs, TestDocBasedVersionConstraints, TestSort, UUIDUpdateProcessorFallbackTest, TestSchemaManager, TestStandardQParsers, MultiThreadedOCPTest, TestExactSharedStatsCache, HLLUtilTest, TestDocSet, TestJsonRequest, BasicDistributedZk2Test, TestLeaderElectionZkExpiry, TestAddFieldRealTimeGet, DistributedQueryElevationComponentTest, TestPerFieldSimilarity, AsyncMigrateRouteKeyTest, DistributedFacetPivotSmallTest, CdcrReplicationHandlerTest, HdfsChaosMonkeySafeLeaderTest, SOLR749Test, TestCopyFieldCollectionResource, OpenExchangeRatesOrgProviderTest, RemoteQueryErrorTest, NumericFieldsTest, ReplicationFactorTest, TestExtendedDismaxParser, CircularListTest, FullSolrCloudDistribCmdsTest, TestCollapseQParserPlugin, TestCollectionAPI, TestManagedSchema, TestReRankQParserPlugin, OverseerTest, RankQueryTest, SynonymTokenizerTest, TestIntervalFaceting, HardAutoCommitTest, AliasIntegrationTest, TermVectorComponentDistributedTest, TestPseudoReturnFields, SearchHandlerTest, TestBM25SimilarityFactory, TestZkChroot, TestManagedSchemaDynamicFieldResource, TestSchemaResource, DistribCursorPagingTest, SoftAutoCommitTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestSolrQueryParser, AutoCommitTest, TestDistributedMissingSort, QueryParsingTest, QueryEqualityTest, XmlUpdateRequestHandlerTest, CdcrVersionReplicationTest, SaslZkACLProviderTest, TestRecovery, SpellCheckCollatorTest, SolrInfoMBeanTest, LeaderElectionTest, FacetPivotSmallTest, SortByFunctionTest, TestQuerySenderNoQuery, TestSolrXml, SyncSliceTest, RecoveryZkTest, TestReplicationHandler, CollectionReloadTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, DeleteInactiveReplicaTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest, HttpPartitionTest, SharedFSAutoReplicaFailoverTest, HdfsCollectionsAPIDistributedZkTest]
   [junit4] Completed [443/541] on J2 in 485.70s, 1 test, 1 error <<< FAILURES!

[...truncated 321 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1432: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:987: There were test failures: 541 suites, 2134 tests, 2 errors, 26 ignored (14 assumptions)

Total time: 213 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Mime
View raw message