lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Policeman Jenkins Server <jenk...@thetaphi.de>
Subject [JENKINS] Lucene-Solr-7.x-Solaris (64bit/jdk1.8.0) - Build # 839 - Still Unstable!
Date Tue, 02 Oct 2018 00:01:12 GMT
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/839/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testSearchRate

Error Message:
{srt=[CapturedEvent{timestamp=767816923727894, stage=AFTER_ACTION, actionName='compute', event={   "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",   "source":"search_rate_trigger",   "eventTime":767814249235344,   "eventType":"SEARCHRATE",   "properties":{     "hotReplicas":[       {"core_node1":{           "core":"collection1_shard1_replica_n1",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10030_solr",           "type":"NRT",           "leader":"true",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}},       {"core_node2":{           "core":"collection1_shard1_replica_n2",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10028_solr",           "type":"NRT",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}}],     "__start__":3,     "coldNodes":{},     "coldShards":{},     "coldReplicas":[],     "violationType":["hotShards"],     "coldCollections":{},     "hotShards":{"collection1":{"shard1":250.0}},     "hotCollections":{"collection1":500.0},     "hotNodes":{       "127.0.0.1:10030_solr":250.0,       "127.0.0.1:10028_solr":250.0},     "_enqueue_time_":767815672278094,     "requestedOps":[       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute]}, config={   "beforeAction":[],   "trigger":"search_rate_trigger",   "stage":[     "FAILED",     "SUCCEEDED"],   "afterAction":[     "compute",     "execute",     "test"],   "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767819860013194, stage=AFTER_ACTION, actionName='execute', event={   "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",   "source":"search_rate_trigger",   "eventTime":767814249235344,   "eventType":"SEARCHRATE",   "properties":{     "hotReplicas":[       {"core_node1":{           "core":"collection1_shard1_replica_n1",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10030_solr",           "type":"NRT",           "leader":"true",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}},       {"core_node2":{           "core":"collection1_shard1_replica_n2",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10028_solr",           "type":"NRT",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}}],     "__start__":3,     "coldNodes":{},     "coldShards":{},     "coldReplicas":[],     "violationType":["hotShards"],     "coldCollections":{},     "hotShards":{"collection1":{"shard1":250.0}},     "hotCollections":{"collection1":500.0},     "hotNodes":{       "127.0.0.1:10030_solr":250.0,       "127.0.0.1:10028_solr":250.0},     "_enqueue_time_":767815672278094,     "requestedOps":[       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute, execute], properties.responses=[{status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute, execute]}, config={   "beforeAction":[],   "trigger":"search_rate_trigger",   "stage":[     "FAILED",     "SUCCEEDED"],   "afterAction":[     "compute",     "execute",     "test"],   "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767819874396144, stage=AFTER_ACTION, actionName='test', event={   "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",   "source":"search_rate_trigger",   "eventTime":767814249235344,   "eventType":"SEARCHRATE",   "properties":{     "hotReplicas":[       {"core_node1":{           "core":"collection1_shard1_replica_n1",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10030_solr",           "type":"NRT",           "leader":"true",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}},       {"core_node2":{           "core":"collection1_shard1_replica_n2",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10028_solr",           "type":"NRT",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}}],     "__start__":3,     "coldNodes":{},     "coldShards":{},     "coldReplicas":[],     "violationType":["hotShards"],     "coldCollections":{},     "hotShards":{"collection1":{"shard1":250.0}},     "hotCollections":{"collection1":500.0},     "hotNodes":{       "127.0.0.1:10030_solr":250.0,       "127.0.0.1:10028_solr":250.0},     "_enqueue_time_":767815672278094,     "requestedOps":[       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute, execute, test], properties.responses=[{status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute, execute, test]}, config={   "beforeAction":[],   "trigger":"search_rate_trigger",   "stage":[     "FAILED",     "SUCCEEDED"],   "afterAction":[     "compute",     "execute",     "test"],   "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767819947025194, stage=SUCCEEDED, actionName='null', event={   "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",   "source":"search_rate_trigger",   "eventTime":767814249235344,   "eventType":"SEARCHRATE",   "properties":{     "hotReplicas":[       {"core_node1":{           "core":"collection1_shard1_replica_n1",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10030_solr",           "type":"NRT",           "leader":"true",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}},       {"core_node2":{           "core":"collection1_shard1_replica_n2",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10028_solr",           "type":"NRT",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}}],     "__start__":3,     "coldNodes":{},     "coldShards":{},     "coldReplicas":[],     "violationType":["hotShards"],     "coldCollections":{},     "hotShards":{"collection1":{"shard1":250.0}},     "hotCollections":{"collection1":500.0},     "hotNodes":{       "127.0.0.1:10030_solr":250.0,       "127.0.0.1:10028_solr":250.0},     "_enqueue_time_":767815672278094,     "requestedOps":[       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}}]}}, context={}, config={   "beforeAction":[],   "trigger":"search_rate_trigger",   "stage":[     "FAILED",     "SUCCEEDED"],   "afterAction":[     "compute",     "execute",     "test"],   "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767825529027444, stage=AFTER_ACTION, actionName='compute', event={   "id":"2ba52f8125b70Te1rj0ojh1ysyahba15qn4rv3r",   "source":"search_rate_trigger",   "eventTime":767815465458544,   "eventType":"SEARCHRATE",   "properties":{     "hotReplicas":[       {"core_node1":{           "core":"collection1_shard1_replica_n1",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10030_solr",           "type":"NRT",           "leader":"true",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}},       {"core_node2":{           "core":"collection1_shard1_replica_n2",           "shard":"shard1",           "collection":"collection1",           "node_name":"127.0.0.1:10028_solr",           "type":"NRT",           "SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,           "INDEX.sizeInBytes":10240,           "rate":250.0,           "state":"active",           "QUERY./select.requestTimes:1minRate":250,           "INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}}],     "__start__":3,     "coldNodes":{},     "coldShards":{},     "coldReplicas":[],     "violationType":["hotShards"],     "coldCollections":{},     "hotShards":{"collection1":{"shard1":100.0}},     "hotCollections":{"collection1":500.0},     "hotNodes":{       "127.0.0.1:10030_solr":250.0,       "127.0.0.1:10028_solr":250.0},     "_enqueue_time_":767825157475194,     "requestedOps":[       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}},       {         "action":"ADDREPLICA",         "hints":{"COLL_SHARD":[{               "first":"collection1",               "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute]}, config={   "beforeAction":[],   "trigger":"search_rate_trigger",   "stage":[     "FAILED",     "SUCCEEDED"],   "afterAction":[     "compute",     "execute",     "test"],   "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}]} expected:<4> but was:<5>

Stack Trace:
java.lang.AssertionError: {srt=[CapturedEvent{timestamp=767816923727894, stage=AFTER_ACTION, actionName='compute', event={
  "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",
  "source":"search_rate_trigger",
  "eventTime":767814249235344,
  "eventType":"SEARCHRATE",
  "properties":{
    "hotReplicas":[
      {"core_node1":{
          "core":"collection1_shard1_replica_n1",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10030_solr",
          "type":"NRT",
          "leader":"true",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      {"core_node2":{
          "core":"collection1_shard1_replica_n2",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10028_solr",
          "type":"NRT",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}}],
    "__start__":3,
    "coldNodes":{},
    "coldShards":{},
    "coldReplicas":[],
    "violationType":["hotShards"],
    "coldCollections":{},
    "hotShards":{"collection1":{"shard1":250.0}},
    "hotCollections":{"collection1":500.0},
    "hotNodes":{
      "127.0.0.1:10030_solr":250.0,
      "127.0.0.1:10028_solr":250.0},
    "_enqueue_time_":767815672278094,
    "requestedOps":[
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute]}, config={
  "beforeAction":[],
  "trigger":"search_rate_trigger",
  "stage":[
    "FAILED",
    "SUCCEEDED"],
  "afterAction":[
    "compute",
    "execute",
    "test"],
  "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767819860013194, stage=AFTER_ACTION, actionName='execute', event={
  "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",
  "source":"search_rate_trigger",
  "eventTime":767814249235344,
  "eventType":"SEARCHRATE",
  "properties":{
    "hotReplicas":[
      {"core_node1":{
          "core":"collection1_shard1_replica_n1",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10030_solr",
          "type":"NRT",
          "leader":"true",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      {"core_node2":{
          "core":"collection1_shard1_replica_n2",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10028_solr",
          "type":"NRT",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}}],
    "__start__":3,
    "coldNodes":{},
    "coldShards":{},
    "coldReplicas":[],
    "violationType":["hotShards"],
    "coldCollections":{},
    "hotShards":{"collection1":{"shard1":250.0}},
    "hotCollections":{"collection1":500.0},
    "hotNodes":{
      "127.0.0.1:10030_solr":250.0,
      "127.0.0.1:10028_solr":250.0},
    "_enqueue_time_":767815672278094,
    "requestedOps":[
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute, execute], properties.responses=[{status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute, execute]}, config={
  "beforeAction":[],
  "trigger":"search_rate_trigger",
  "stage":[
    "FAILED",
    "SUCCEEDED"],
  "afterAction":[
    "compute",
    "execute",
    "test"],
  "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767819874396144, stage=AFTER_ACTION, actionName='test', event={
  "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",
  "source":"search_rate_trigger",
  "eventTime":767814249235344,
  "eventType":"SEARCHRATE",
  "properties":{
    "hotReplicas":[
      {"core_node1":{
          "core":"collection1_shard1_replica_n1",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10030_solr",
          "type":"NRT",
          "leader":"true",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      {"core_node2":{
          "core":"collection1_shard1_replica_n2",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10028_solr",
          "type":"NRT",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}}],
    "__start__":3,
    "coldNodes":{},
    "coldShards":{},
    "coldReplicas":[],
    "violationType":["hotShards"],
    "coldCollections":{},
    "hotShards":{"collection1":{"shard1":250.0}},
    "hotCollections":{"collection1":500.0},
    "hotNodes":{
      "127.0.0.1:10030_solr":250.0,
      "127.0.0.1:10028_solr":250.0},
    "_enqueue_time_":767815672278094,
    "requestedOps":[
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.async=search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0, params.waitForFinalState=true, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute, execute, test], properties.responses=[{status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}, {status={state=completed, msg=found [search_rate_trigger/2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o/0] in completed tasks}, success=}], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute, execute, test]}, config={
  "beforeAction":[],
  "trigger":"search_rate_trigger",
  "stage":[
    "FAILED",
    "SUCCEEDED"],
  "afterAction":[
    "compute",
    "execute",
    "test"],
  "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767819947025194, stage=SUCCEEDED, actionName='null', event={
  "id":"2ba52af944390Te1rj0ojh1ysyahba15qn4rv3o",
  "source":"search_rate_trigger",
  "eventTime":767814249235344,
  "eventType":"SEARCHRATE",
  "properties":{
    "hotReplicas":[
      {"core_node1":{
          "core":"collection1_shard1_replica_n1",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10030_solr",
          "type":"NRT",
          "leader":"true",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      {"core_node2":{
          "core":"collection1_shard1_replica_n2",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10028_solr",
          "type":"NRT",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}}],
    "__start__":3,
    "coldNodes":{},
    "coldShards":{},
    "coldReplicas":[],
    "violationType":["hotShards"],
    "coldCollections":{},
    "hotShards":{"collection1":{"shard1":250.0}},
    "hotCollections":{"collection1":500.0},
    "hotNodes":{
      "127.0.0.1:10030_solr":250.0,
      "127.0.0.1:10028_solr":250.0},
    "_enqueue_time_":767815672278094,
    "requestedOps":[
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}}]}}, context={}, config={
  "beforeAction":[],
  "trigger":"search_rate_trigger",
  "stage":[
    "FAILED",
    "SUCCEEDED"],
  "afterAction":[
    "compute",
    "execute",
    "test"],
  "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}, CapturedEvent{timestamp=767825529027444, stage=AFTER_ACTION, actionName='compute', event={
  "id":"2ba52f8125b70Te1rj0ojh1ysyahba15qn4rv3r",
  "source":"search_rate_trigger",
  "eventTime":767815465458544,
  "eventType":"SEARCHRATE",
  "properties":{
    "hotReplicas":[
      {"core_node1":{
          "core":"collection1_shard1_replica_n1",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10030_solr",
          "type":"NRT",
          "leader":"true",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      {"core_node2":{
          "core":"collection1_shard1_replica_n2",
          "shard":"shard1",
          "collection":"collection1",
          "node_name":"127.0.0.1:10028_solr",
          "type":"NRT",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "rate":250.0,
          "state":"active",
          "QUERY./select.requestTimes:1minRate":250,
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}}],
    "__start__":3,
    "coldNodes":{},
    "coldShards":{},
    "coldReplicas":[],
    "violationType":["hotShards"],
    "coldCollections":{},
    "hotShards":{"collection1":{"shard1":100.0}},
    "hotCollections":{"collection1":500.0},
    "hotNodes":{
      "127.0.0.1:10030_solr":250.0,
      "127.0.0.1:10028_solr":250.0},
    "_enqueue_time_":767825157475194,
    "requestedOps":[
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}},
      {
        "action":"ADDREPLICA",
        "hints":{"COLL_SHARD":[{
              "first":"collection1",
              "second":"shard1"}]}}]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10028_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$AddReplica, method=GET, params.action=ADDREPLICA, params.collection=collection1, params.shard=shard1, params.node=127.0.0.1:10030_solr, params.type=NRT}], properties.BEFORE_ACTION=[start, compute], source=search_rate_trigger, properties.AFTER_ACTION=[start, compute]}, config={
  "beforeAction":[],
  "trigger":"search_rate_trigger",
  "stage":[
    "FAILED",
    "SUCCEEDED"],
  "afterAction":[
    "compute",
    "execute",
    "test"],
  "class":"org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerListener"}, message='null'}]} expected:<4> but was:<5>
	at __randomizedtesting.SeedInfo.seed([941D3539315B2BCF:C9552BB0FE9D8D80]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testSearchRate(TestSimTriggerIntegration.java:1272)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testNodeAddedTriggerRestoreState

Error Message:


Stack Trace:
java.util.ConcurrentModificationException
	at __randomizedtesting.SeedInfo.seed([941D3539315B2BCF:1C20BC460B9BCA62]:0)
	at java.util.TreeMap.forEach(TreeMap.java:1008)
	at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.lambda$dumpClusterState$14(SimCloudManager.java:396)
	at java.util.TreeMap.forEach(TreeMap.java:1005)
	at org.apache.solr.cloud.autoscaling.sim.SimCloudManager.dumpClusterState(SimCloudManager.java:394)
	at org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.tearDown(SimSolrCloudTestCase.java:76)
	at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:993)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 14351 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimTriggerIntegration_941D3539315B2BCF-001/init-core-data-001
   [junit4]   2> 3987452 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10027_solr
   [junit4]   2> 3987453 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 3987453 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3987453 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version -1
   [junit4]   2> 3987453 INFO  (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory.
   [junit4]   2> 3987453 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0
   [junit4]   2> 3987453 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 3987453 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 3987454 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10028_solr, 127.0.0.1:10027_solr]
   [junit4] IGNOR/A 0.00s J0 | TestSimTriggerIntegration.testTriggerThrottling
   [junit4]    > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
   [junit4]   2> 3987454 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3987454 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 3987454 DEBUG (ScheduledTrigger-13888-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4] IGNOR/A 0.00s J0 | TestSimTriggerIntegration.testNodeAddedTrigger
   [junit4]    > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
   [junit4]   2> 3987475 DEBUG (ScheduledTrigger-13888-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987514 DEBUG (ScheduledTrigger-13888-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987535 DEBUG (ScheduledTrigger-13888-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987538 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
   [junit4]   2> 3987538 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 3987538 INFO  (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
   [junit4]   2> 3987541 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 3987541 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3987541 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3987541 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 3987541 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 3987541 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 3987541 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1220) ~[?:1.8.0_172]
   [junit4]   2> 	at java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:335) ~[?:1.8.0_172]
   [junit4]   2> 	at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:177) [java/:?]
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]
   [junit4]   2> 3987542 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 3987542 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 3987542 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 3987542 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
   [junit4]   2> 3987542 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion -1
   [junit4]   2> 3987542 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 3987542 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10028_solr, 127.0.0.1:10027_solr]
   [junit4]   2> 3987543 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3987543 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 3987543 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987567 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987588 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987609 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987630 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987643 DEBUG (simCloudManagerPool-13892-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3987646 DEBUG (simCloudManagerPool-13892-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 3987647 DEBUG (simCloudManagerPool-13892-thread-1) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3987647 DEBUG (simCloudManagerPool-13892-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
   [junit4]   2> 3987647 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 3987647 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3987647 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 3987648 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3987648 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 3987651 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987671 DEBUG (simCloudManagerPool-13892-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3987671 DEBUG (simCloudManagerPool-13892-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 3987671 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3987671 DEBUG (simCloudManagerPool-13892-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for .system / shard1: {"core_node1":{
   [junit4]   2>     "core":".system_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":".system",
   [junit4]   2>     "node_name":"127.0.0.1:10028_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 3987673 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3987673 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 3987678 DEBUG (simCloudManagerPool-13892-thread-4) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3987678 DEBUG (simCloudManagerPool-13892-thread-4) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 3987679 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 3987679 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 3987679 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial livenodes: [127.0.0.1:10028_solr, 127.0.0.1:10027_solr]
   [junit4]   2> 3987679 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerAction}], enabled=true}
   [junit4]   2> 3987679 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 3987679 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987679 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 3987692 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987702 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987702 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987702 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10029_solr at time 767775342597794
   [junit4]   2> 3987712 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987722 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987722 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987733 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987742 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987742 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987755 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987763 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987763 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987775 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987784 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987784 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987796 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987813 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987813 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987816 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987834 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987834 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987837 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987854 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987854 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987858 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987883 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987883 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 3
   [junit4]   2> 3987883 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987911 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3987911 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 3987911 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:10029_solr] added at times [767775342597794], now=767785803859944
   [junit4]   2> 3987911 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2ba49a09016a2Te1rj0ojh1ysyahba15qn4rv3i",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":767775342597794,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[767775342597794],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10029_solr"]}}
   [junit4]   2> 3987914 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_trigger]
   [junit4]   2> 3987915 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - removing marker path: /autoscaling/nodeAdded/127.0.0.1:10029_solr
   [junit4]   2> 3987915 DEBUG (AutoscalingActionExecutor-13894-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2ba49a09016a2Te1rj0ojh1ysyahba15qn4rv3i",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":767775342597794,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[767775342597794],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":767785939924694,
   [junit4]   2>     "nodeNames":["127.0.0.1:10029_solr"]}}
   [junit4]   2> 3987916 DEBUG (AutoscalingActionExecutor-13894-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 3987916 DEBUG (AutoscalingActionExecutor-13894-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 100ms
   [junit4]   2> 3987916 DEBUG (AutoscalingActionExecutor-13894-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing took 67 ms for event id=2ba49a09016a2Te1rj0ojh1ysyahba15qn4rv3i
   [junit4]   2> 3988017 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988017 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988017 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988017 DEBUG (ScheduledTrigger-13893-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:10030_solr at time 767791091208794
   [junit4]   2> 3988038 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988038 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988038 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988059 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988059 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988059 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988079 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988079 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988079 DEBUG (ScheduledTrigger-13893-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988111 DEBUG (ScheduledTrigger-13893-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988111 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988111 DEBUG (ScheduledTrigger-13893-thread-2) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988128 INFO  (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
   [junit4]   2> 3988128 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 3988128 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 3988128 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 3988128 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 3988128 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 3988128 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 3988128 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 3988129 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
   [junit4]   2> 3988129 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion -1
   [junit4]   2> 3988129 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 3988129 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10029_solr, 127.0.0.1:10030_solr, 127.0.0.1:10028_solr, 127.0.0.1:10027_solr]
   [junit4]   2> 3988147 INFO  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.s.TestSimTriggerIntegration TestTriggerAction init
   [junit4]   2> 3988147 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial livenodes: [127.0.0.1:10029_solr, 127.0.0.1:10030_solr, 127.0.0.1:10028_solr, 127.0.0.1:10027_solr]
   [junit4]   2> 3988147 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988147 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration$TestTriggerAction}], enabled=true}
   [junit4]   2> 3988147 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeAddedTrigger Adding node from marker path: 127.0.0.1:10030_solr
   [junit4]   2> 3988147 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - removing marker path: /autoscaling/nodeAdded/127.0.0.1:10030_solr
   [junit4]   2> 3988148 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988148 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 3988148 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988171 DEBUG (ScheduledTrigger-13896-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988171 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988171 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988193 DEBUG (ScheduledTrigger-13896-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988196 DEBUG (ScheduledTrigger-13896-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988196 DEBUG (ScheduledTrigger-13896-thread-3) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988213 DEBUG (ScheduledTrigger-13896-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 4
   [junit4]   2> 3988217 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 3988217 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 3988217 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:10030_solr] added at times [767791091208794], now=767801096370444
   [junit4]   2> 3988217 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2ba4d4b40d25aTe1rj0ojh1ysyahba15qn4rv3l",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":767791091208794,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[767791091208794],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10030_solr"]}}
   [junit4]   2> 3988223 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, node_added_trigger]
   [junit4]   2> 3988224 DEBUG (ScheduledTrigger-13896-thread-1) [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - removing marker path: /autoscaling/nodeAdded/127.0.0.1:10030_solr
   [junit4]   2> 3988224 DEBUG (AutoscalingActionExecutor-13897-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2ba4d4b40d25aTe1rj0ojh1ysyahba15qn4rv3l",
   [junit4]   2>   "source":"node_added_trigger",
   [junit4]   2>   "eventTime":767791091208794,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[767791091208794],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":767801402560144,
   [junit4]   2>     "nodeNames":["127.0.0.1:10030_solr"]}}
   [junit4]   2> 3988225 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988225 DEBUG (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 3988225 INFO  (TEST-TestSimTriggerIntegration.testEventFromRestoredState-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimSolrCloudTestCase #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:		4
   [junit4]   2> ## Empty nodes:	3
   [junit4]   2> ## Dead nodes:		0
   [junit4]   2> ## Collections:
   [junit4]   2> ##  * .system
   [junit4]   2> ##    shardsTotal	1
   [junit4]   2> ##    shardsState	{active=1}
   [junit4]   2> ##      shardsWithoutLeader	0
   [junit4]   2> ##    totalReplicas	1
   [junit4]   2> ##      activeReplicas	1
   [junit4]   2> ##      inactiveReplicas	0
   [junit4]   2> ##    totalActiveDocs	4
   [junit4]   2> ##      bufferedDocs	0
   [junit4]   2> ##      maxActiveSliceDocs	4
   [junit4]   2> ##      minActiveSliceDocs	4
   [junit4]   2> ##      avgActiveSliceDocs	4
   [junit4]   2> ##    totalInactiveDocs	0
   [junit4]   2> ##      maxInactiveSliceDocs	0
   [junit4]   2> ##      minInactiveSliceDocs	0
   [junit4]   2> ##      avgInactiveSliceDocs	NaN
   [junit4]   2> ##    totalActiveBytes	12,240
   [junit4]   2> ##      maxActiveSliceBytes	12,240
   [junit4]   2> ##      minActiveSliceBytes	12,240
   [junit4]   2> ##      avgActiveSliceBytes	12,240
   [junit4]   2> ##    totalInactiveBytes	0
   [junit4]   2> ##      maxInactiveSliceBytes	0
   [junit4]   2> ##      minInactiveSliceBytes	0
   [junit4]   2> ##      avgInactiveSliceBytes	NaN
   [junit4]   2> ##    totalActiveDeletedDocs	0
   [junit4]   2> ## Max replicas per node:	1
   [junit4]   2> ## Min replicas per node:	0
   [junit4]   2> ## Total replicas:		1
   [junit4]   2> ## * .system		1
   [junit4]   2> ##		- active           1
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ##		- autoscaling        2
   [junit4]   2> ##		- update             4
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: node_added_trigger
   [junit4]   2> ##		- STARTED         2
   [junit4]   2> ##		- SUCCEEDED       2
   [junit4]   2> 
   [junit4] IGNOR/A 0.00s J0 | TestSimTriggerIntegration.testListeners
   [junit4]    > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
   [junit4]   2> 3988227 DEBUG (AutoscalingActionExecutor-13897-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 3988227 DEBUG (AutoscalingActionExecutor-13897-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger after 100ms
   [junit4]   2> 3988227 DEBUG (AutoscalingActionExecutor-13897-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing took 170 ms for event id=2ba4d4b40d25aTe1rj0ojh1ysyahba15qn4rv3l
   [junit4]   2> 3988281 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
   [junit4]   2> 3988282 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10029_solr
   [junit4]   2> 3988282 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 3988282 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimNodeStateProvider --removing value for 127.0.0.1:10027_solr
   [junit4]   2> 3988282 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 127.0.0.1:10030_solr
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimNodeStateProvider --removing value for 127.0.0.1:10029_solr
   [junit4]   2> 3988282 INFO  (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache...
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 3988282 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 3988283 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 3988283 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers
   [junit4]   2> 3988283 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
   [junit4]   2> 3988283 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion -1
   [junit4]   2> 3988283 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
   [junit4]   2> 3988283 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10030_solr, 127.0.0.1:10028_solr]
   [junit4]   2> 3988284 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3988284 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 3988284 DEBUG (ScheduledTrigger-13899-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988308 DEBUG (ScheduledTrigger-13899-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988328 DEBUG (ScheduledTrigger-13899-thread-4) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988348 DEBUG (ScheduledTrigger-13899-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988369 DEBUG (ScheduledTrigger-13899-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988389 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988390 DEBUG (simCloudManagerPool-13898-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988390 DEBUG (simCloudManagerPool-13898-thread-1) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 3988390 DEBUG (simCloudManagerPool-13898-thread-1) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3988390 DEBUG (simCloudManagerPool-13898-thread-1) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
   [junit4]   2> 3988391 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
   [junit4]   2> 3988391 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988391 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 3988391 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3988391 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 3988411 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988414 DEBUG (simCloudManagerPool-13898-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988414 DEBUG (simCloudManagerPool-13898-thread-2) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 3988414 DEBUG (simCloudManagerPool-13898-thread-3) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for .system / shard1: {"core_node2":{
   [junit4]   2>     "core":".system_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":".system",
   [junit4]   2>     "node_name":"127.0.0.1:10028_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 3988416 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988416 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 3988417 DEBUG (simCloudManagerPool-13898-thread-4) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988417 DEBUG (simCloudManagerPool-13898-thread-4) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 3988432 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988438 DEBUG (simCloudManagerPool-13898-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988438 DEBUG (simCloudManagerPool-13898-thread-5) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 3988438 DEBUG (simCloudManagerPool-13898-thread-7) [    ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for collection1 / shard1: {"core_node1":{
   [junit4]   2>     "core":"collection1_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"collection1",
   [junit4]   2>     "node_name":"127.0.0.1:10030_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 3988448 DEBUG (simCloudManagerPool-13898-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988449 DEBUG (simCloudManagerPool-13898-thread-6) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 3988449 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 3988449 DEBUG (TEST-TestSimTriggerIntegration.testSearchRate-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 3988452 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988453 DEBUG (simCloudManagerPool-13898-thread-8) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3988454 DEBUG (simCloudManagerPool-13898-thread-8) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
   [junit4]   2> 3988454 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
   [junit4]   2> 3988454 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3988454 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
   [junit4]   2> 3988456 DEBUG (simCloudManagerPool-13898-thread-9) [    ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 3988457 DEBUG (simCloudManagerPool-13898-thread-9) [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
   [junit4]   2> 3988457 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
   [junit4]   2> 3988457 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 3988457 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
   [junit4]   2> 3988457 DEBUG (ScheduledTrigger-13899-thread-2) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10030_solr
   [junit4]   2> 3988457 DEBUG (ScheduledTrigger-13899-thread-2) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10028_solr
   [junit4]   2> 3988472 DEBUG (ScheduledTrigger-13899-thread-2) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988479 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10030_solr
   [junit4]   2> 3988479 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate	250
   [junit4]   2> 3988479 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10028_solr
   [junit4]   2> 3988480 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate	250
   [junit4]   2> 3988480 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: collection1
   [junit4]   2> 3988480 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ##  - shard1
   [junit4]   2> 3988480 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ##     collection1_shard1_replica_n1  250.0
   [junit4]   2> 3988480 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger ##     collection1_shard1_replica_n2  250.0
   [junit4]   2> 3988480 DEBUG (ScheduledTrigger-13899-thread-3) [    ] o.a.s.c.a.SearchRateTrigger -- collection1.shard1: totalShardRate=500.0, shardRate=250.0
   [junit4]   2> 3988492 DEBUG (ScheduledTrigger-13899-thread-1) [    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2
   [junit4]   2> 3988504 DEBUG (ScheduledTrigger-13899-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10030_solr
   [junit4]   2> 3988504 DEBUG (ScheduledTrigger-13899-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.collection1.shard1.replica_n1:QUERY./select.requestTimes:1minRate	250
   [junit4]   2> 3988504 DEBUG (ScheduledTrigger-13899-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ### rates for node 127.0.0.1:10028_solr
   [junit4]   2> 3988504 DEBUG (ScheduledTrigger-13899-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ###  metrics:solr.core.collection1.shard1.replica_n2:QUERY./select.requestTimes:1minRate	250
   [junit4]   2> 3988504 DEBUG (ScheduledTrigger-13899-thread-4) [    ] o.a.s.c.a.SearchRateTrigger ## Collection: collection1
   [junit4]   2> 3988504 DEBUG (ScheduledTrigger-13899-thread-4) [    ] o.a.s.c.a.Searc

[...truncated too long message...]

02-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 11055 DEBUG (AutoscalingActionExecutor-102-thread-1) [    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 100ms
   [junit4]   2> 11055 DEBUG (AutoscalingActionExecutor-102-thread-1) [    ] o.a.s.c.a.ScheduledTriggers -- processing took 40 ms for event id=24fd47a93dad5Te1rj0ojh1ysyahba15qn4rosw
   [junit4]   2> 11099 INFO  (TEST-TestSimTriggerIntegration.testCooldown-seed#[941D3539315B2BCF]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCooldown
   [junit4]   2> 11099 DEBUG (TEST-TestSimTriggerIntegration.testCooldown-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states
   [junit4]   2> 11100 DEBUG (TEST-TestSimTriggerIntegration.testCooldown-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 63
   [junit4]   2> 11100 INFO  (TEST-TestSimTriggerIntegration.testCooldown-seed#[941D3539315B2BCF]) [    ] o.a.s.c.a.s.SimSolrCloudTestCase #######################################
   [junit4]   2> ############ CLUSTER STATE ############
   [junit4]   2> #######################################
   [junit4]   2> ## Live nodes:		4
   [junit4]   2> ## Empty nodes:	3
   [junit4]   2> ## Dead nodes:		0
   [junit4]   2> ## Collections:
   [junit4]   2> ##  * .system
   [junit4]   2> ##    shardsTotal	1
   [junit4]   2> ##    shardsState	{active=1}
   [junit4]   2> ##      shardsWithoutLeader	0
   [junit4]   2> ##    totalReplicas	1
   [junit4]   2> ##      activeReplicas	1
   [junit4]   2> ##      inactiveReplicas	0
   [junit4]   2> ##    totalActiveDocs	4
   [junit4]   2> ##      bufferedDocs	0
   [junit4]   2> ##      maxActiveSliceDocs	4
   [junit4]   2> ##      minActiveSliceDocs	4
   [junit4]   2> ##      avgActiveSliceDocs	4
   [junit4]   2> ##    totalInactiveDocs	0
   [junit4]   2> ##      maxInactiveSliceDocs	0
   [junit4]   2> ##      minInactiveSliceDocs	0
   [junit4]   2> ##      avgInactiveSliceDocs	NaN
   [junit4]   2> ##    totalActiveBytes	12,240
   [junit4]   2> ##      maxActiveSliceBytes	12,240
   [junit4]   2> ##      minActiveSliceBytes	12,240
   [junit4]   2> ##      avgActiveSliceBytes	12,240
   [junit4]   2> ##    totalInactiveBytes	0
   [junit4]   2> ##      maxInactiveSliceBytes	0
   [junit4]   2> ##      minInactiveSliceBytes	0
   [junit4]   2> ##      avgInactiveSliceBytes	NaN
   [junit4]   2> ##    totalActiveDeletedDocs	0
   [junit4]   2> ## Max replicas per node:	1
   [junit4]   2> ## Min replicas per node:	0
   [junit4]   2> ## Total replicas:		1
   [junit4]   2> ## * .system		1
   [junit4]   2> ##		- active           1
   [junit4]   2> ######### Solr op counts ##########
   [junit4]   2> ##		- autoscaling        3
   [junit4]   2> ##		- update             4
   [junit4]   2> ######### Autoscaling event counts ###########
   [junit4]   2> ## * Trigger: node_added_cooldown_trigger
   [junit4]   2> ##		- STARTED         2
   [junit4]   2> ##		- SUCCEEDED       2
   [junit4]   2> ## * Trigger: node_added_restore_trigger
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> ## * Trigger: node_added_trigger
   [junit4]   2> ##		- FAILED          1
   [junit4]   2> ##		- STARTED         6
   [junit4]   2> ##		- SUCCEEDED       5
   [junit4]   2> ## * Trigger: node_added_trigger1
   [junit4]   2> ##		- FAILED          1
   [junit4]   2> ##		- STARTED         3
   [junit4]   2> ##		- SUCCEEDED       2
   [junit4]   2> ## * Trigger: node_added_trigger2
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> ## * Trigger: node_lost_restore_trigger
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> ## * Trigger: node_lost_trigger
   [junit4]   2> ##		- STARTED         2
   [junit4]   2> ##		- SUCCEEDED       2
   [junit4]   2> ## * Trigger: node_lost_trigger1
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> ## * Trigger: node_lost_trigger2
   [junit4]   2> ##		- STARTED         1
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> ## * Trigger: search_rate_trigger
   [junit4]   2> ##		- FAILED          1
   [junit4]   2> ##		- STARTED         2
   [junit4]   2> ##		- SUCCEEDED       1
   [junit4]   2> 
   [junit4] OK      0.35s J1 | TestSimTriggerIntegration.testCooldown
   [junit4]   2> 11101 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 11101 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 11101 WARN  (Simulated OverseerAutoScalingTriggerThread) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 11101 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 11102 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor
   [junit4]   2> 11102 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 11102 DEBUG (SUITE-TestSimTriggerIntegration-seed#[941D3539315B2BCF]-worker) [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestSimTriggerIntegration_941D3539315B2BCF-001
   [junit4]   2> Oct 01, 2018 11:58:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=sv-SE, timezone=Asia/Amman
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_172 (64-bit)/cpus=3,threads=1,free=81588312,total=97386496
   [junit4]   2> NOTE: All tests run in this JVM: [TestSimTriggerIntegration, TestSimTriggerIntegration]
   [junit4] Completed [4/5 (1!)] on J1 in 3.93s, 11 tests, 1 error <<< FAILURES!
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration
   [junit4] OK      0.37s J0 | TestSimTriggerIntegration.testTriggerThrottling
   [junit4] OK      0.41s J0 | TestSimTriggerIntegration.testNodeAddedTrigger
   [junit4] OK      0.66s J0 | TestSimTriggerIntegration.testEventFromRestoredState
   [junit4] OK      0.38s J0 | TestSimTriggerIntegration.testListeners
   [junit4] OK      0.35s J0 | TestSimTriggerIntegration.testSearchRate
   [junit4] OK      0.19s J0 | TestSimTriggerIntegration.testNodeLostTriggerRestoreState
   [junit4] OK      0.37s J0 | TestSimTriggerIntegration.testNodeMarkersRegistration
   [junit4] OK      0.27s J0 | TestSimTriggerIntegration.testEventQueue
   [junit4] OK      0.18s J0 | TestSimTriggerIntegration.testNodeAddedTriggerRestoreState
   [junit4] OK      0.24s J0 | TestSimTriggerIntegration.testNodeLostTrigger
   [junit4] OK      0.33s J0 | TestSimTriggerIntegration.testCooldown
   [junit4] Completed [5/5 (1!)] on J0 in 3.78s, 11 tests
   [junit4] 
   [junit4] 
   [junit4] Tests with failures [seed: 941D3539315B2BCF]:
   [junit4]   - org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration.testNodeAddedTriggerRestoreState
   [junit4] 
   [junit4] 
   [junit4] JVM J0:     0.67 ..    15.34 =    14.66s
   [junit4] JVM J1:     0.68 ..    12.24 =    11.56s
   [junit4] Execution time total: 15 seconds
   [junit4] Tests summary: 5 suites, 55 tests, 1 error

BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1567: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/lucene/common-build.xml:1092: There were test failures: 5 suites, 55 tests, 1 error [seed: 941D3539315B2BCF]

Total time: 17 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   1/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimTriggerIntegration
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=6e6b00a0df7e86c8e8959788362ae3ff3d88b83f, workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #838
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

Mime
View raw message