kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Otto <o...@wikimedia.org>
Subject Re: best python library to use?
Date Mon, 11 Jan 2016 16:28:49 GMT
pykafka’s balanced consumer is very useful. pykafka also has Python
bindings to the librdkafka C library that you can optionally enable, which
might get you some speed boosts.

python-kafka (oh, I just saw this 0.9x version, hm!) was better at
producing than pykafka for us, so we am currently using pykafka for
consumption, and python-kafka for production.  python-kafka allows you to
produce to multiple topics using the same client instance.  (pykafka may
support this soon: https://github.com/Parsely/pykafka/issues/354)



On Sat, Jan 9, 2016 at 10:04 AM, Dana Powers <dana.powers@gmail.com> wrote:

> pykafka uses a custom zookeeper implementation for consumer groups.
> kafka-python uses the 0.9.0.0 server apis to accomplish the same.
>
> -Dana
> On Jan 8, 2016 18:32, "chengxin Cai" <iacxc@outlook.com> wrote:
>
> > Hi
> >
> > I heard that Pykakfa can create a balanced consumer.
> >
> > And there should be no other big difference.
> >
> >
> > Best Regards
> >
> > > 在 2016年1月9日,08:58,Dana Powers <dana.powers@rd.io> 写道:
> > >
> > > Hi Doug,
> > >
> > > The differences are fairly subtle. kafka-python is a community-backed
> > > project that aims to be consistent w/ the official java client; pykafka
> > is
> > > sponsored by parse.ly and aims to provide a pythonic interface.
> > whichever
> > > you go with, I would love to hear your specific feedback on
> kafka-python.
> > >
> > > -Dana (kafka-python maintainer)
> > >
> > >> On Fri, Jan 8, 2016 at 4:32 PM, Doug Tomm <dctomm@gmail.com> wrote:
> > >>
> > >> we're using kafka-python, weighing pykafka, and wondering if there's
> > >> another that is bettor to use.  does confluent endorse or recommend a
> > >> particular python package (psorry for the alliteration)?
> > >>
> > >> doug
> > >>
> > >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message