spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ofir Manor (JIRA)" <>
Subject [jira] [Commented] (SPARK-18057) Update structured streaming kafka from 10.0.1 to 10.2.0
Date Sun, 26 Feb 2017 09:21:21 GMT


Ofir Manor commented on SPARK-18057:

[] I think my previous issue with upgrading to Kafka 0.10.1 client has
been resolved in Kafka 0.10.2 - since now newer clients DO support older brokers:
The Java clients (producer and consumer) have acquired the ability to communicate with older
brokers. Version 0.10.2 clients can talk to version 0.10.0 or newer brokers. Note that some
features are not available or are limited when older brokers are used.
So it seems safe to upgrade Spark's Kafka client to 0.10.2, as it shouldn't bump up the minimum
required version of the Kafka broker.
What do you think?

> Update structured streaming kafka from 10.0.1 to 10.2.0
> -------------------------------------------------------
>                 Key: SPARK-18057
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>            Reporter: Cody Koeninger
> There are a couple of relevant KIPs here,

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message