kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Haojin Gui <guihao...@gmail.com>
Subject Re: How to create a reliable and fast Kafka Producer in a web server?
Date Fri, 05 Dec 2014 05:12:56 GMT
Thank you, Guozhang!

On Thu, Dec 4, 2014 at 9:14 AM, Guozhang Wang <wangguoz@gmail.com> wrote:

> Haojin,
>
> With the old "synchronized" API you can also enable asynchrony with this
> config "producer.type" in the producer configs:
>
> http://kafka.apache.org/documentation.html#producerconfigs
>
> The new "asynchronized" producer improves performance by using pipelining.
>
> Guozhang
>
>
>
> On Wed, Dec 3, 2014 at 4:03 PM, Haojin Gui <guihaojin@gmail.com> wrote:
>
> > Hi,
> >
> > I am using Playframework to build a web server that needs to handle very
> > heavy traffic. And it has a Kafka Producer sending messages to Kafka
> > brokers.
> >
> > Currently I am using the synchronized Kafka producer API and seems like
> > it's affecting the performance of the web server. I am considering
> > switching to async Producer API but not sure how reliable it is(I heard
> it
> > might loss message). Are there any other options to minimize the
> Producer's
> > affect to the server.
> >
> > Thanks,
> > Haojin
> >
>
>
>
> --
> -- Guozhang
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message