flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9899) Add more metrics to the Kinesis source connector
Date Thu, 02 Aug 2018 10:03:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16566569#comment-16566569
] 

ASF GitHub Bot commented on FLINK-9899:
---------------------------------------

tzulitai commented on issue #6409: [FLINK-9899][Kinesis Connecotr] Add comprehensive per-shard
metrics to ShardConsumer
URL: https://github.com/apache/flink/pull/6409#issuecomment-409875134
 
 
   @glaksh100 what's the status of this PR? As Chesnay mentioned, we need to document connector
metrics.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Add more metrics to the Kinesis source connector
> ------------------------------------------------
>
>                 Key: FLINK-9899
>                 URL: https://issues.apache.org/jira/browse/FLINK-9899
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kinesis Connector
>    Affects Versions: 1.4.2, 1.5.1
>            Reporter: Lakshmi Rao
>            Assignee: Lakshmi Rao
>            Priority: Major
>              Labels: pull-request-available
>
> Currently there are sparse metrics available for the Kinesis Connector. Using the [ShardMetricsReporter|https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/metrics/ShardMetricsReporter.java] add
more stats. For example:
> - sleepTimeMillis 
> - maxNumberOfRecordsPerFetch
> - numberOfAggregatedRecordsPerFetch
> - numberOfDeaggregatedRecordsPerFetch
> - bytesPerFetch
> - averageRecordSizeBytes
> - runLoopTimeNanos
> - loopFrequencyHz



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message