spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cody Koeninger <c...@koeninger.org>
Subject Re: Kafaka 0.8, 0.9 in Structured Streaming
Date Fri, 07 Oct 2016 21:25:05 GMT
The main thing is picking up new partitions.  You can't do that
without reimplementing portions of the consumer rebalance.  The
low-level consumer is really low level, and the old high-level
consumer is basically broken (it might have been fixed by the time
they abandoned it, I dunno)

On Fri, Oct 7, 2016 at 3:56 PM, Michael Armbrust <michael@databricks.com> wrote:
>> Without a hell of a lot more work, Assign would be the only strategy
>> usable.
>
>
> How would the current "subscribe" break?
>

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Mime
View raw message