flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4035) Add Apache Kafka 0.10 connector
Date Tue, 11 Oct 2016 08:15:21 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15564862#comment-15564862
] 

ASF GitHub Bot commented on FLINK-4035:
---------------------------------------

Github user rmetzger commented on the issue:

    https://github.com/apache/flink/pull/2231
  
    @radekg I've added Kafka 0.10 support to Flink, that's why I closed this pull request.
My change preserved your commit from this pull request. Thank you for the contribution!


> Add Apache Kafka 0.10 connector
> -------------------------------
>
>                 Key: FLINK-4035
>                 URL: https://issues.apache.org/jira/browse/FLINK-4035
>             Project: Flink
>          Issue Type: Bug
>          Components: Kafka Connector
>    Affects Versions: 1.0.3
>            Reporter: Elias Levy
>            Assignee: Robert Metzger
>            Priority: Minor
>             Fix For: 1.2.0
>
>
> Kafka 0.10.0.0 introduced protocol changes related to the producer.  Published messages
now include timestamps and compressed messages now include relative offsets.  As it is now,
brokers must decompress publisher compressed messages, assign offset to them, and recompress
them, which is wasteful and makes it less likely that compression will be used at all.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message