lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrzej Bialecki (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SOLR-9858) Collect aggregated metrics from nodes and shard leaders in overseer
Date Thu, 16 Feb 2017 13:55:41 GMT

     [ https://issues.apache.org/jira/browse/SOLR-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrzej Bialecki  updated SOLR-9858:
------------------------------------
    Attachment: SOLR-9858.patch

Cumulative patch for this issue and SOLR-9857. I'd appreciate review.

A few notes on the design:
* for each replica a {{SolrReplicaReporter}} is created, which periodically sends selected
metrics to {{MetricsCollectorHandler}} running on shard leader. These metrics are sent as
regular SolrInputDocument-s, and they contain fields that indicate the source reporter and
the target registry where they are to be collected and aggregated.
* for each node a {{SolrOverseerReporter}} is created, which periodically sends selected metrics
from selected registries to a node where Overseer leader is located. {{MetricsColelctorHandler}}
running on that node collects and aggregates these metrics in "solr.overseer" registry.
Please consult javadoc for these classes for examples of configurations, as well as {{SolrCloudReportersTest}}
that shows what kind of reports are expected.

> Collect aggregated metrics from nodes and shard leaders in overseer
> -------------------------------------------------------------------
>
>                 Key: SOLR-9858
>                 URL: https://issues.apache.org/jira/browse/SOLR-9858
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: metrics
>    Affects Versions: master (7.0)
>            Reporter: Andrzej Bialecki 
>            Assignee: Andrzej Bialecki 
>            Priority: Minor
>         Attachments: SOLR-9858.patch
>
>
> Overseer can collect metrics from Solr nodes and shard leaders in order to have a notion
of the indexing / query / replication / system load on each node, shard and its replicas.
This information then can be used for cluster (auto)scaling.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message