flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3398) Flink Kafka consumer should support auto-commit opt-outs
Date Tue, 05 Apr 2016 13:59:25 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226294#comment-15226294

ASF GitHub Bot commented on FLINK-3398:

Github user StephanEwen commented on the pull request:

    I think the functionality is very desirable. In many cases, you really don't want Flink
to write something to Zookeeper for some random GroupId. This floods ZooKeeper with garbage
that helps no one.
    I think that this is actually a kind of nice solution. The `auto.commit.enable` in Flink
means not necessary periodically, but "on checkpoint or periodically".

> Flink Kafka consumer should support auto-commit opt-outs
> --------------------------------------------------------
>                 Key: FLINK-3398
>                 URL: https://issues.apache.org/jira/browse/FLINK-3398
>             Project: Flink
>          Issue Type: Bug
>            Reporter: Shikhar Bhushan
> Currently the Kafka source will commit consumer offsets to Zookeeper, either upon a checkpoint
if checkpointing is enabled, otherwise periodically based on {{auto.commit.interval.ms}}
> It should be possible to opt-out of committing consumer offsets to Zookeeper. Kafka has
this config as {{auto.commit.enable}} (0.8) and {{enable.auto.commit}} (0.9).

This message was sent by Atlassian JIRA

View raw message