flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Martin Eden (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-7689) Instrument the Flink JDBC sink
Date Tue, 26 Sep 2017 06:36:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Martin Eden updated FLINK-7689:
-------------------------------
    Description: 
As confirmed by the Flink community in the following mailing list [message|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/metrics-for-Flink-sinks-td15200.html]
 using off the shelf Flink sinks like the JDBC sink, Redis sink or Cassandra sink etc does
not expose any sink specific metrics.

The purpose of this ticket is to add some relevant metrics to the JDBCOutputFormat:
- Meters for when a flush is made.
- Histograms for the jdbc batch count and batch execution latency.

These would allow deeper understanding of the runtime behaviour of performance critical jobs
writing to external databases using this generic interface.


  was:
As confirmed by the Flink community in the following mailing list [message|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/metrics-for-Flink-sinks-td15200.html]
 using off the shelf Flink sinks like the JDBC sink, Redis sink or Cassandra sink etc does
not expose any sink specific metrics.

The purpose of this ticket is to add some relevant metrics to the JDBCSinkFunction and JDBCOutputFormat:
- Meters for when a flush is made or snapshot state is called.
- Histograms for the jdbc batch count and batch execution latency.

These would allow deeper understanding of the runtime behaviour of performance critical jobs
writing to external databases using this generic interface.



> Instrument the Flink JDBC sink
> ------------------------------
>
>                 Key: FLINK-7689
>                 URL: https://issues.apache.org/jira/browse/FLINK-7689
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming Connectors
>    Affects Versions: 1.4.0
>            Reporter: Martin Eden
>            Priority: Minor
>              Labels: jdbc, metrics
>             Fix For: 1.4.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> As confirmed by the Flink community in the following mailing list [message|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/metrics-for-Flink-sinks-td15200.html]
 using off the shelf Flink sinks like the JDBC sink, Redis sink or Cassandra sink etc does
not expose any sink specific metrics.
> The purpose of this ticket is to add some relevant metrics to the JDBCOutputFormat:
> - Meters for when a flush is made.
> - Histograms for the jdbc batch count and batch execution latency.
> These would allow deeper understanding of the runtime behaviour of performance critical
jobs writing to external databases using this generic interface.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message