kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: How to create a reliable and fast Kafka Producer in a web server?
Date Thu, 04 Dec 2014 17:14:25 GMT
Haojin,

With the old "synchronized" API you can also enable asynchrony with this
config "producer.type" in the producer configs:

http://kafka.apache.org/documentation.html#producerconfigs

The new "asynchronized" producer improves performance by using pipelining.

Guozhang



On Wed, Dec 3, 2014 at 4:03 PM, Haojin Gui <guihaojin@gmail.com> wrote:

> Hi,
>
> I am using Playframework to build a web server that needs to handle very
> heavy traffic. And it has a Kafka Producer sending messages to Kafka
> brokers.
>
> Currently I am using the synchronized Kafka producer API and seems like
> it's affecting the performance of the web server. I am considering
> switching to async Producer API but not sure how reliable it is(I heard it
> might loss message). Are there any other options to minimize the Producer's
> affect to the server.
>
> Thanks,
> Haojin
>



-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message