samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yi Pan <nickpa...@gmail.com>
Subject Re: Running apache samza with Kafka Client 1.0 - JIRA - SAMZA - 1418
Date Mon, 27 Nov 2017 07:59:52 GMT
Hi, Debraj,

Makes sense. I have opened a ticket to upgrade Samza's Kafka client
libraries to 0.11 (SAMZA-1509). If you have concerns/suggestions, please
add comments to that ticket.

Thanks!

-Yi

On Wed, Nov 22, 2017 at 10:04 AM, Debraj Manna <subharaj.manna@gmail.com>
wrote:

> Since we were moving our brokers to 1.0 so was trying to have the same
> client version.
>
> Sent from GMail on Android
>
> On Nov 22, 2017 11:32 PM, "Yi Pan" <nickpan47@gmail.com> wrote:
>
> > And just one more question on your requirement for Kafka Client 1.0: is
> > this requirement because of your broker version is Kafka 1.0? Or you want
> > some client side features from Kafka client 1.0?
> >
> > Just talked to our in-house Kafka expert and confirmed that Kafka client
> > 0.10.1 should be able to talk to higher version of Kafka broker,
> including
> > 1.0, if the concern is on client/broker compatibility.
> >
> > -Yi
> >
> > On Wed, Nov 22, 2017 at 9:52 AM, Yi Pan <nickpan47@gmail.com> wrote:
> >
> > > Hi, Debraj,
> > >
> > > First, yes, this is the correct forum for user questions as well.
> > >
> > > Second, we are actively working on a patch to bring in Kafka 0.11
> client
> > > in Samza. It would require a lot of testing on Samza side to make sure:
> > 1)
> > > back-compat w/ older version of brokers; 2) performance test. We
> already
> > > have a PR to include Kafka 0.11 under review.
> > >
> > > Thanks!
> > >
> > > -Yi
> > >
> > > On Wed, Nov 22, 2017 at 6:04 AM, Debraj Manna <
> subharaj.manna@gmail.com>
> > > wrote:
> > >
> > >> Hi
> > >>
> > >>
> > >> I am facing the same below issue when trying to use kafka client 1.0
> > with
> > >> samza
> > >>
> > >> https://issues.apache.org/jira/browse/SAMZA-1418
> > >>
> > >> I could not find any related ticket with a fix.
> > >>
> > >> How are we supposed to run apache samza with the latest Kafka Client
> > 1.0?
> > >> It looks like I have to use kafka-clients-0.11.0.0.jar .
> > >>
> > >> *Versions*
> > >> Kafka Broker / Cluster - 1.0
> > >> samza-api-0.13.0.jar
> > >> samza-core_2.11-0.13.0.jar
> > >> samza-kafka_2.11-0.13.0.jar
> > >> samza-kv_2.11-0.13.0.jar
> > >> samza-yarn_2.11-0.13.0.jar
> > >>
> > >>
> > >> *PS - I could not find any users mailing list for samza in mailing
> list
> > >> <http://samza.apache.org/community/mailing-lists.html> page. If this
> is
> > >> not
> > >> the right forum to ask this query. Can you please point me to the
> > correct
> > >> forum?*
> > >>
> > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message