kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yuanjia <yuanjia8...@163.com>
Subject Re: Re: when will the messsages be sent to broker
Date Thu, 02 Mar 2017 02:30:29 GMT
Records are not sent out  immediately, even if configing batch.size=0 and linger.ms=0, They
are buffered in the memory(buffer.memory).
I don't want to do sync writes by future.get, which performance is not good.
Have any configure can increase sending frequency? config buffer.memory=0?


Yuanjia Li
From: Matthias J. Sax
Date: 2017-03-02 01:42
To: users
Subject: Re: when will the messsages be sent to broker
There is also linger.ms parameter that is an upper bound how long a (not
yet filled) buffer is hold before sending it even if it's not full.
Furthermore, you can do sync writes and block until producer received
all acks. But it might have a performance penalty.
On 3/1/17 6:55 AM, Kaufman Ng wrote:
> By default producer batches records (into a buffer) until batch.size is
> reached, then records will be sent out.  Try lowering batch.size in your
> producer config.
> You might want to look at the producer javadoc here:
> http://kafka.apache.org/0102/javadoc/index.html?org/apache/kafka/clients/producer/KafkaProducer.html
> On Wed, Mar 1, 2017 at 3:14 AM, Yuanjia <yuanjia8947@163.com> wrote:
>> Hi all,
>> When will the messsages be sent in kafka0.10.0?If I use KafkaProducer.send
>> to send one message, the messsages isn't sent immediately except invoke
>> flush or close.
>> Thanks.
>> Yuanjia Li
下载: http://u.163.com/t0/bUAsgYsTI8W0
预览: http://u.163.com/t0/GHwkOppxnZbj
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message