hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Masatake Iwasaki (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-12511) Add support for InfluxDB as metrics sink
Date Sat, 07 Nov 2015 07:14:11 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995081#comment-14995081
] 

Masatake Iwasaki commented on HADOOP-12511:
-------------------------------------------

This is sample configuration in hadoop-metrics2.properties. ({{protocol=http}}, {{servers=localhost:8086}}
and {{db=mydb}} are default values.)

{noformat}
*.sink.influxdb.protocol=http
*.sink.influxdb.servers=localhost:8086
*.sink.influxdb.db=mydb
namenode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.InfluxDBSink
datanode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.InfluxDBSink
{noformat}

You can use UDP to send metrics to InfluxDB. You need explicit [configuration to make InfluxDB
service UDP|https://influxdb.com/docs/v0.9/write_protocols/udp.html]. Syntax for {{servers}}
is same to GanGliaSink. When using UDP, target database is set in InfluxDB server side settings.

{noformat}
*.sink.influxdb.protocol=udp
*.sink.influxdb.servers=host1:8087,host2:8087
namenode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.InfluxDBSink
datanode.sink.influxdb.class=org.apache.hadoop.metrics2.sink.InfluxDBSink
{noformat}

> Add support for InfluxDB as metrics sink
> ----------------------------------------
>
>                 Key: HADOOP-12511
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12511
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: metrics
>            Reporter: Masatake Iwasaki
>            Assignee: Masatake Iwasaki
>         Attachments: HADOOP-12511.001.patch, HADOOP-12511.002.patch
>
>
> Add InfluxDBSink to write metrics to InfluxDB. Because [the Line Protocol of InfluxDB|https://influxdb.com/docs/v0.9/write_protocols/line.html]
expects data structure similar to MetricsRecord consisting of tags, metric values and timestamp,
we can easily map the records to the format. We can use REST API or UDP to send records to
InfluxDB.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message