flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor
Date Sun, 19 Jun 2016 17:18:05 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15338613#comment-15338613

ASF GitHub Bot commented on FLINK-4020:

Github user tzulitai commented on the issue:

    Hi @rmetzger,
    Update: I'm closing this PR now. The new PR with FLINK-4020 & FLINK-3231 is at https://github.com/apache/flink/pull/2131.

> Remove shard list querying from Kinesis consumer constructor
> ------------------------------------------------------------
>                 Key: FLINK-4020
>                 URL: https://issues.apache.org/jira/browse/FLINK-4020
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Kinesis Connector, Streaming Connectors
>            Reporter: Tzu-Li (Gordon) Tai
>            Assignee: Tzu-Li (Gordon) Tai
>             Fix For: 1.1.0
> Currently FlinkKinesisConsumer is querying for the whole list of shards in the constructor,
forcing the client to be able to access Kinesis as well. This is also a drawback for handling
Kinesis-side resharding, since we'd want all shard listing / shard-to-task assigning / shard
end (result of resharding) handling logic to be capable of being independently done within
task life cycle methods, with defined and definite results.

This message was sent by Atlassian JIRA

View raw message