lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Jenkins Server <jenk...@builds.apache.org>
Subject [JENKINS] Lucene-Solr-Tests-master - Build # 1205 - Failure
Date Wed, 08 Jun 2016 23:21:10 GMT
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1205/

3 tests failed.
FAILED:  org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior

Error Message:
Illegal state, was: down expected:active clusterState:live nodes:[]collections:{c1=DocCollection(c1)={   "shards":{"shard1":{       "parent":null,       "range":null,       "state":"active",       "replicas":{"core_node1":{           "base_url":"http://127.0.0.1/solr",           "node_name":"node1",           "core":"core1",           "roles":"",           "state":"down"}}}},   "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}

Stack Trace:
java.lang.AssertionError: Illegal state, was: down expected:active clusterState:live nodes:[]collections:{c1=DocCollection(c1)={
  "shards":{"shard1":{
      "parent":null,
      "range":null,
      "state":"active",
      "replicas":{"core_node1":{
          "base_url":"http://127.0.0.1/solr",
          "node_name":"node1",
          "core":"core1",
          "roles":"",
          "state":"down"}}}},
  "router":{"name":"implicit"}}, test=LazyCollectionRef(test)}
	at __randomizedtesting.SeedInfo.seed([CB2577E0AE83409E:A33B740C4C131AD0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.verifyReplicaStatus(AbstractDistribZkTestBase.java:243)
	at org.apache.solr.cloud.OverseerTest.testExternalClusterStateChangeBehavior(OverseerTest.java:1273)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler

Error Message:
ObjectTracker found 2 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory]
	at __randomizedtesting.SeedInfo.seed([CB2577E0AE83409E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:256)
	at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup

Error Message:
Failed to create backup

Stack Trace:
java.lang.AssertionError: Failed to create backup
	at __randomizedtesting.SeedInfo.seed([CB2577E0AE83409E:8AAE5785893DB3D1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.CheckBackupStatus.fetchStatus(CheckBackupStatus.java:50)
	at org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup(TestReplicationHandlerBackup.java:199)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11240 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandlerBackup
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/init-core-data-001
   [junit4]   2> 744851 INFO  (SUITE-TestReplicationHandlerBackup-seed#[CB2577E0AE83409E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
   [junit4]   2> 744870 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTestBackup
   [junit4]   2> 744870 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1
   [junit4]   2> 744877 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 744954 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64015fab{/solr,null,AVAILABLE}
   [junit4]   2> 744955 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.ServerConnector Started ServerConnector@ed7dfa1{HTTP/1.1,[http/1.1]}{127.0.0.1:48193}
   [junit4]   2> 744955 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.Server Started @748263ms
   [junit4]   2> 744955 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=48193}
   [junit4]   2> 744955 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 744955 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001'
   [junit4]   2> 744956 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 744956 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 744956 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/solr.xml
   [junit4]   2> 744991 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/.
   [junit4]   2> 744991 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer New CoreContainer 1239646635
   [junit4]   2> 744991 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001]
   [junit4]   2> 744992 WARN  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/lib
   [junit4]   2> 744992 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
   [junit4]   2> 745014 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
   [junit4]   2> 745017 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 745017 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 745017 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 745017 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 745017 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/.
   [junit4]   2> 745018 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 745018 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1
   [junit4]   2> 745018 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 745034 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1'
   [junit4]   2> 745034 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 745034 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 745035 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0
   [junit4]   2> 745035 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 745038 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 745046 WARN  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 745047 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 745077 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 745079 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 745081 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 745098 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1'
   [junit4]   2> 745098 INFO  (coreLoadExecutor-2771-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1
   [junit4]   2> 745098 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 745099 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 745099 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 745099 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data
   [junit4]   2> 745099 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/index/
   [junit4]   2> 745099 WARN  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 745099 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 745099 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 745100 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@68e8f25f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@35f917b2),segFN=segments_1,generation=1}
   [junit4]   2> 745100 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 745113 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 745114 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 745115 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 745115 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 745116 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 745116 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/sql,/update/json/docs,/admin/luke,/graph,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 745116 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 745120 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/
   [junit4]   2> 745135 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 745135 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 745135 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=85.4677734375, floorSegmentMB=1.03125, forceMergeDeletesPctAllowed=27.030639689473006, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.631715023123584
   [junit4]   2> 745135 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@68e8f25f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@35f917b2),segFN=segments_1,generation=1}
   [junit4]   2> 745135 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 745135 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6cc9ebc9[collection1] main]
   [junit4]   2> 745136 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1/conf
   [junit4]   2> 745136 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1/conf}
   [junit4]   2> 745136 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1/conf
   [junit4]   2> 745136 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 745136 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema-replication2.xml:schema.xml
   [junit4]   2> 745136 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 745136 INFO  (coreLoadExecutor-2771-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 745137 INFO  (searcherExecutor-2772-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6cc9ebc9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 745554 INFO  (qtp1265958554-6210) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 745555 INFO  (qtp1265958554-6210) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 1
   [junit4]   2> 745557 INFO  (qtp1265958554-6211) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 0
   [junit4]   2> 745557 INFO  (qtp1265958554-6212) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 745558 INFO  (qtp1265958554-6212) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
   [junit4]   2> 745558 INFO  (qtp1265958554-6214) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
   [junit4]   2> 745559 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
   [junit4]   2> 745559 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
   [junit4]   2> 745560 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 745561 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@68e8f25f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@35f917b2),segFN=segments_1,generation=1}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@68e8f25f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@35f917b2),segFN=segments_2,generation=2}
   [junit4]   2> 745561 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 745569 INFO  (Thread-2009) [    x:collection1] o.a.s.h.SnapShooter Creating backup snapshot <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/
   [junit4]   2> 745569 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@55c8edcc[collection1] main]
   [junit4]   2> 745569 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 745569 INFO  (searcherExecutor-2772-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@55c8edcc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.0.0):C6)))}
   [junit4]   2> 745569 INFO  (qtp1265958554-6207) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 9
   [junit4]   2> 745581 INFO  (qtp1265958554-6212) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=backup} status=0 QTime=9
   [junit4]   2> 745582 INFO  (Thread-2010) [    x:collection1] o.a.s.h.SnapShooter Creating backup snapshot <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/
   [junit4]   2> 745590 INFO  (qtp1265958554-6213) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=details} status=0 QTime=0
   [junit4]   2> 745592 INFO  (Thread-2010) [    x:collection1] o.a.s.h.SnapShooter Done creating backup snapshot: <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/
   [junit4]   2> 745594 ERROR (Thread-2009) [    x:collection1] o.a.s.h.SnapShooter Exception while creating snapshot
   [junit4]   2> java.nio.file.NoSuchFileException: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/collection1/data/snapshot.20160608202503706/_0_Lucene50_0.tip
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
   [junit4]   2> 	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
   [junit4]   2> 	at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
   [junit4]   2> 	at java.nio.file.Files.newOutputStream(Files.java:216)
   [junit4]   2> 	at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:408)
   [junit4]   2> 	at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:404)
   [junit4]   2> 	at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:253)
   [junit4]   2> 	at org.apache.lucene.store.Directory.copyFrom(Directory.java:154)
   [junit4]   2> 	at org.apache.solr.handler.SnapShooter.copyFiles(SnapShooter.java:241)
   [junit4]   2> 	at org.apache.solr.handler.SnapShooter.createSnapshot(SnapShooter.java:175)
   [junit4]   2> 	at org.apache.solr.handler.SnapShooter$2.run(SnapShooter.java:148)
   [junit4]   2> 746591 INFO  (qtp1265958554-6210) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=details} status=0 QTime=0
   [junit4]   2> 746591 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending doTestBackup
   [junit4]   2> 746592 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@ed7dfa1{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 746592 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1239646635
   [junit4]   2> 746602 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5d2367c1
   [junit4]   2> 746602 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=6,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
   [junit4]   2> 746602 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 746602 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 746602 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/index;done=false>>]
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data;done=false>>]
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 746606 INFO  (coreCloseExecutor-2776-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-001/./collection1/data
   [junit4]   2> 746611 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@64015fab{/solr,null,UNAVAILABLE}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandlerBackup -Dtests.method=doTestBackup -Dtests.seed=CB2577E0AE83409E -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-PR -Dtests.timezone=America/St_Johns -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 1.76s J0 | TestReplicationHandlerBackup.doTestBackup <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Failed to create backup
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CB2577E0AE83409E:8AAE5785893DB3D1]:0)
   [junit4]    > 	at org.apache.solr.handler.CheckBackupStatus.fetchStatus(CheckBackupStatus.java:50)
   [junit4]    > 	at org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup(TestReplicationHandlerBackup.java:199)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 746614 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBackupOnCommit
   [junit4]   2> 746614 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1
   [junit4]   2> 746617 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 746691 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a01d479{/solr,null,AVAILABLE}
   [junit4]   2> 746692 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.ServerConnector Started ServerConnector@60e89451{HTTP/1.1,[http/1.1]}{127.0.0.1:37318}
   [junit4]   2> 746710 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.Server Started @750018ms
   [junit4]   2> 746710 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=37318}
   [junit4]   2> 746710 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 746710 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002'
   [junit4]   2> 746710 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 746710 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 746710 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/solr.xml
   [junit4]   2> 746714 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/.
   [junit4]   2> 746714 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer New CoreContainer 277278082
   [junit4]   2> 746714 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002]
   [junit4]   2> 746714 WARN  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/lib
   [junit4]   2> 746714 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
   [junit4]   2> 746719 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
   [junit4]   2> 746722 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 746722 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 746722 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 746722 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 746723 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/.
   [junit4]   2> 746724 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 746724 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1
   [junit4]   2> 746724 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 746731 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0
   [junit4]   2> 746731 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 746732 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1'
   [junit4]   2> 746732 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 746732 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 746736 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 746750 WARN  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 746750 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 746754 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 746756 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 746758 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 746759 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1'
   [junit4]   2> 746759 INFO  (coreLoadExecutor-2783-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1
   [junit4]   2> 746759 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 746759 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 746759 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 746759 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data
   [junit4]   2> 746759 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/index/
   [junit4]   2> 746759 WARN  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 746760 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 746760 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 746768 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@461cbb2d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a4beaf6),segFN=segments_1,generation=1}
   [junit4]   2> 746768 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 746775 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 746776 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 746777 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 746777 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 746778 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 746779 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/sql,/update/json/docs,/admin/luke,/graph,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 746779 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 746782 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/
   [junit4]   2> 746784 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 746784 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 746784 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=85.4677734375, floorSegmentMB=1.03125, forceMergeDeletesPctAllowed=27.030639689473006, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.631715023123584
   [junit4]   2> 746784 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@461cbb2d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a4beaf6),segFN=segments_1,generation=1}
   [junit4]   2> 746784 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 746784 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7e1c0e7b[collection1] main]
   [junit4]   2> 746785 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1/conf
   [junit4]   2> 746785 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1/conf}
   [junit4]   2> 746785 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/collection1/conf
   [junit4]   2> 746785 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 746785 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema-replication2.xml:schema.xml
   [junit4]   2> 746785 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 746785 INFO  (coreLoadExecutor-2783-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 746785 INFO  (searcherExecutor-2784-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7e1c0e7b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 747246 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 747258 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 12
   [junit4]   2> 747262 INFO  (qtp375129032-6235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 3
   [junit4]   2> 747263 INFO  (qtp375129032-6236) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 747270 INFO  (qtp375129032-6236) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
   [junit4]   2> 747270 INFO  (qtp375129032-6236) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
   [junit4]   2> 747271 INFO  (qtp375129032-6231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
   [junit4]   2> 747271 INFO  (qtp375129032-6231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
   [junit4]   2> 747272 INFO  (qtp375129032-6235) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
   [junit4]   2> 747272 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
   [junit4]   2> 747278 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
   [junit4]   2> 747278 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
   [junit4]   2> 747279 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
   [junit4]   2> 747279 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
   [junit4]   2> 747279 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
   [junit4]   2> 747280 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
   [junit4]   2> 747280 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
   [junit4]   2> 747280 INFO  (qtp375129032-6238) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
   [junit4]   2> 747281 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
   [junit4]   2> 747281 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
   [junit4]   2> 747282 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
   [junit4]   2> 747290 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
   [junit4]   2> 747290 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
   [junit4]   2> 747291 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
   [junit4]   2> 747291 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
   [junit4]   2> 747292 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
   [junit4]   2> 747292 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
   [junit4]   2> 747292 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
   [junit4]   2> 747507 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
   [junit4]   2> 747511 INFO  (qtp375129032-6231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
   [junit4]   2> 747511 INFO  (qtp375129032-6231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
   [junit4]   2> 747511 INFO  (qtp375129032-6231) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
   [junit4]   2> 747512 INFO  (qtp375129032-6236) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
   [junit4]   2> 747512 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
   [junit4]   2> 747513 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
   [junit4]   2> 747513 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
   [junit4]   2> 747513 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
   [junit4]   2> 747514 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 747538 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@461cbb2d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a4beaf6),segFN=segments_1,generation=1}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@461cbb2d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a4beaf6),segFN=segments_2,generation=2}
   [junit4]   2> 747539 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 747543 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@43d068d[collection1] main]
   [junit4]   2> 747544 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 747544 INFO  (searcherExecutor-2784-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@43d068d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(7.0.0):C35)))}
   [junit4]   2> 747544 INFO  (qtp375129032-6237) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 30
   [junit4]   2> 747544 INFO  (Thread-2023) [    x:collection1] o.a.s.h.SnapShooter Creating backup snapshot <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/
   [junit4]   2> 747545 INFO  (qtp375129032-6234) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=details} status=0 QTime=0
   [junit4]   2> 747547 INFO  (Thread-2023) [    x:collection1] o.a.s.h.SnapShooter Done creating backup snapshot: <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/
   [junit4]   2> 748546 INFO  (qtp375129032-6235) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=details} status=0 QTime=0
   [junit4]   2> 749548 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBackupOnCommit
   [junit4]   2> 749554 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@60e89451{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 749554 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=277278082
   [junit4]   2> 749566 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@77d95291
   [junit4]   2> 749566 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=35,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
   [junit4]   2> 749566 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 749566 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 749566 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 749566 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 749567 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 749567 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data;done=false>>]
   [junit4]   2> 749567 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 749567 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data
   [junit4]   2> 749568 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/index;done=false>>]
   [junit4]   2> 749568 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 749568 INFO  (coreCloseExecutor-2788-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 749569 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3a01d479{/solr,null,UNAVAILABLE}
   [junit4]   2> 749570 INFO  (SUITE-TestReplicationHandlerBackup-seed#[CB2577E0AE83409E]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandlerBackup_CB2577E0AE83409E-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {name=Lucene50(blocksize=128), id=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=276, maxMBSortInHeap=5.969945272300723, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=es-PR, timezone=America/St_Johns
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=140482992,total=530055168
   [junit4]   2> NOTE: All tests run in this JVM: [TolerantUpdateProcessorTest, TestAnalyzeInfixSuggestions, DistributedDebugComponentTest, TestOmitPositions, TestSchemaNameResource, TestMergePolicyConfig, TestJoin, TestFreeTextSuggestions, RequiredFieldsTest, QueryElevationComponentTest, DisMaxRequestHandlerTest, AlternateDirectoryTest, LeaderElectionIntegrationTest, TestLuceneMatchVersion, TestExceedMaxTermLength, OverseerTaskQueueTest, SOLR749Test, SystemInfoHandlerTest, SynonymTokenizerTest, LeaderInitiatedRecoveryOnCommitTest, TestFastOutputStream, DistributedSuggestComponentTest, StandardRequestHandlerTest, TestLRUStatsCache, TestExpandComponent, TestCustomSort, JsonLoaderTest, TestRebalanceLeaders, TestXmlQParser, BasicDistributedZkTest, TestArbitraryIndexDir, RAMDirectoryFactoryTest, ParsingFieldUpdateProcessorsTest, TestRemoteStreaming, TestSizeLimitedDistributedMap, TestStressLucene, DateFieldTest, TestFaceting, BlockDirectoryTest, DistributedQueryElevationComponentTest, TestLRUCache, TestGraphTermsQParserPlugin, TestJsonRequest, TestClassicSimilarityFactory, TestFieldCacheSortRandom, TestFieldResource, PrimUtilsTest, CloneFieldUpdateProcessorFactoryTest, WrapperMergePolicyFactoryTest, TestSortingResponseWriter, BitVectorTest, TestSubQueryTransformerCrossCore, CacheHeaderTest, DateRangeFieldTest, TestImplicitCoreProperties, PeerSyncTest, TestCustomDocTransformer, IndexSchemaTest, TestReloadDeadlock, TestCSVLoader, CurrencyFieldOpenExchangeTest, TestAuthorizationFramework, CdcrVersionReplicationTest, CdcrReplicationDistributedZkTest, TestOrdValues, TestRangeQuery, SmileWriterTest, HdfsLockFactoryTest, TestSolr4Spatial, OutputWriterTest, ConnectionReuseTest, MultiThreadedOCPTest, TestLeaderElectionZkExpiry, CollectionTooManyReplicasTest, TestMiniSolrCloudCluster, TestRealTimeGet, SolrRequestParserTest, TestBadConfig, TestHighlightDedupGrouping, TestReplicationHandlerBackup]
   [junit4] Completed [234/612 (1!)] on J0 in 4.76s, 2 tests, 1 failure <<< FAILURES!

[...truncated 241 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.OverseerTest_CB2577E0AE83409E-001/init-core-data-001
   [junit4]   2> 980334 INFO  (SUITE-OverseerTest-seed#[CB2577E0AE83409E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 980334 INFO  (SUITE-OverseerTest-seed#[CB2577E0AE83409E]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 980334 INFO  (SUITE-OverseerTest-seed#[CB2577E0AE83409E]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 980338 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBadQueueItem
   [junit4]   2> 980338 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 980338 INFO  (Thread-2205) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 980338 INFO  (Thread-2205) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 980438 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.ZkTestServer start zk server on port:43989
   [junit4]   2> 980438 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980439 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980440 INFO  (zkCallback-1384-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5ba2c3a2 name:ZooKeeperConnection Watcher:127.0.0.1:43989 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980440 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980440 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980441 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980442 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980442 INFO  (zkCallback-1385-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@71c727e0 name:ZooKeeperConnection Watcher:127.0.0.1:43989 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980442 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980442 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980442 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 980444 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980445 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980445 INFO  (zkCallback-1386-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2afc6f2b name:ZooKeeperConnection Watcher:127.0.0.1:43989/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980445 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980445 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980445 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 980446 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 980447 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 980448 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 980448 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 980449 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980450 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980451 INFO  (zkCallback-1387-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@332e37e6 name:ZooKeeperConnection Watcher:127.0.0.1:43989/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980451 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980451 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980451 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
   [junit4]   2> 980453 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 980454 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 980455 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 980455 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96038206727323651-127.0.0.1:43989_solr-n_0000000000
   [junit4]   2> 980455 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43989_solr
   [junit4]   2> 980455 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 980456 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.Overseer Overseer (id=96038206727323651-127.0.0.1:43989_solr-n_0000000000) starting
   [junit4]   2> 980457 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 980457 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 980458 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 980459 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 980460 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 980461 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 980462 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 980463 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 980463 INFO  (OverseerCollectionConfigSetProcessor-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 980463 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 980463 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 980463 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 980464 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 980464 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 980465 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980465 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 980465 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980466 INFO  (zkCallback-1392-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1dc9dc9b name:ZooKeeperConnection Watcher:127.0.0.1:43989/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980466 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980466 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980467 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 980467 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 980467 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 980468 INFO  (TEST-OverseerTest.testBadQueueItem-seed#[CB2577E0AE83409E]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1
   [junit4]   2> 980468 INFO  (zkCallback-1386-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 980468 INFO  (zkCallback-1387-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 980469 INFO  (zkCallback-1392-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 980469 INFO  (zkCallback-1386-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 980469 INFO  (zkCallback-1387-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 980473 INFO  (zkCallback-1392-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 980474 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"} current state version: 0
   [junit4]   2> 980474 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "node_name":"127.0.0.1",
   [junit4]   2>   "core":"core1",
   [junit4]   2>   "core_node_name":"node1",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "numShards":"3",
   [junit4]   2>   "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 980474 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 980474 INFO  (OverseerStateUpdate-96038206727323651-127.0.0.1:43989_solr-n_0000000000) [    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 980475 INFO  (zkCallback-1387-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updat

[...truncated too long message...]

ulative_errors=0}
   [junit4]   2> 1130893 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 1130893 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1130893 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1130897 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 1130900 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1130900 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_CB2577E0AE83409E-001/solr-instance-030/./collection1/data/index.20160608190118529 [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_CB2577E0AE83409E-001/solr-instance-030/./collection1/data/index.20160608190118529;done=false>>]
   [junit4]   2> 1130900 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 1130900 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_CB2577E0AE83409E-001/solr-instance-030/./collection1/data/index.20160608190118529
   [junit4]   2> 1130905 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_CB2577E0AE83409E-001/solr-instance-030/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_CB2577E0AE83409E-001/solr-instance-030/./collection1/data;done=false>>]
   [junit4]   2> 1130905 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 1130906 INFO  (coreCloseExecutor-3974-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_CB2577E0AE83409E-001/solr-instance-030/./collection1/data
   [junit4]   2> 1130906 INFO  (TEST-TestReplicationHandler.doTestIndexFetchWithMasterUrl-seed#[CB2577E0AE83409E]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4fa08d91{/solr,null,UNAVAILABLE}
   [junit4]   2> 1130908 INFO  (SUITE-TestReplicationHandler-seed#[CB2577E0AE83409E]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> ObjectTracker found 2 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory]
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:381)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:265)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:388)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:276)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:381)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:265)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:388)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler$1.run(ReplicationHandler.java:276)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {name=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=Memory doPackFST= true), newname=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, maxPointsInLeafNode=1129, maxMBSortInHeap=6.414727763238295, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=pl, timezone=America/Montserrat
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=101043480,total=527433728
   [junit4]   2> NOTE: All tests run in this JVM: [SimplePostToolTest, TestNumericTerms32, DistributedTermsComponentTest, TestFastLRUCache, TestSchemaResource, TestReloadAndDeleteDocs, TestSimpleTrackingShardHandler, DataDrivenBlockJoinTest, TestManagedSchemaAPI, TestPivotHelperCode, DistributedIntervalFacetingTest, HdfsThreadLeakTest, HttpPartitionTest, TestEmbeddedSolrServerConstructors, TestPartialUpdateDeduplication, RecoveryAfterSoftCommitTest, OpenCloseCoreStressTest, DistributedQueryComponentCustomSortTest, CursorMarkTest, LeaderInitiatedRecoveryOnShardRestartTest, TestSystemIdResolver, TermsComponentTest, TestSolrConfigHandlerCloud, TestBlendedInfixSuggestions, HighlighterTest, TestReRankQParserPlugin, MoreLikeThisHandlerTest, TestMiniSolrCloudClusterBase, TestExactSharedStatsCache, ChaosMonkeyNothingIsSafeTest, TestConfigOverlay, DOMUtilTest, TestIntervalFaceting, TestReplicaProperties, TestLMJelinekMercerSimilarityFactory, MultiTermTest, TestBinaryResponseWriter, SoftAutoCommitTest, SuggestComponentTest, TestStressVersions, TestStressUserVersions, IndexBasedSpellCheckerTest, SpellCheckCollatorTest, SolrIndexSplitterTest, TestFieldTypeCollectionResource, TestRTimerTree, UniqFieldsUpdateProcessorFactoryTest, TestChildDocTransformer, ExplicitHLLTest, TestSubQueryTransformerDistrib, TestDocTermOrds, NotRequiredUniqueKeyTest, TestQuerySenderListener, DocExpirationUpdateProcessorFactoryTest, TestGeoJSONResponseWriter, SchemaVersionSpecificBehaviorTest, CloudMLTQParserTest, CoreAdminRequestStatusTest, DocValuesTest, TestHighFrequencyDictionaryFactory, ClusterStateUpdateTest, TestPKIAuthenticationPlugin, DistanceFunctionTest, SolrCmdDistributorTest, TestDFISimilarityFactory, SolrInfoMBeanTest, AliasIntegrationTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestDownShardTolerantSearch, CollectionsAPIAsyncDistributedZkTest, TestHashPartitioner, TestScoreJoinQPNoScore, TestFieldCacheSanityChecker, TestConfigSets, TestDocumentBuilder, MBeansHandlerTest, TestLFUCache, ZkCLITest, TermVectorComponentTest, TestSolrDeletionPolicy2, SpellCheckComponentTest, SolrIndexConfigTest, BufferStoreTest, TestJsonFacets, HdfsCollectionsAPIDistributedZkTest, TestRestManager, SolrPluginUtilsTest, HdfsWriteToMultipleCollectionsTest, TestOnReconnectListenerSupport, BadCopyFieldTest, ZkSolrClientTest, TestDFRSimilarityFactory, SolrXmlInZkTest, TestSerializedLuceneMatchVersion, TestSolrCloudWithKerberosAlt, TestCollectionAPI, OverseerTest, TestReplicationHandler]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandler -Dtests.seed=CB2577E0AE83409E -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=America/Montserrat -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestReplicationHandler (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CB2577E0AE83409E]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:256)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4] Completed [318/612 (3!)] on J1 in 79.46s, 15 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 967 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:531: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1427: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:984: There were test failures: 612 suites (10 ignored), 2560 tests, 1 suite-level error, 2 failures, 87 ignored (72 assumptions) [seed: CB2577E0AE83409E]

Total time: 65 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




Mime
View raw message