kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yu, Libo " <libo...@citi.com>
Subject RE: a few questions about kafka usage
Date Fri, 03 May 2013 20:55:49 GMT
More detail for question 2:
For 5 topic case, 20 producers produce to each topic.
For 10 topic case, 10 producers produce to each topic.

Libo

From: Yu, Libo [ICG-IT]
Sent: Friday, May 03, 2013 4:48 PM
To: 'users@kafka.apache.org'
Subject: a few questions about kafka usage

Hi,

Question 1: If I changed server.properties and added or modified the following line:
                          log.flush.intervals.ms.per.topic=topic1:1000, topic2:3000
                      Do I have to restart the server to pick up the change?

Question 2: I have three machines with one broker on each of them. 100 producers are
                      running on the same three machines. The producers will produce 1M
                      20k-byte messages altogether. The batch size is fixed at 100. For 5
topics
                      each with five partitions, the performance is extremely good. For each
topic,
                     30k messages were produced per second . For 10 topics with 10 partitions,
                     the performance is really bad. For each topic, 400 messages were produced
                     per second. The gap is so huge. Any insight on what may cause the difference?

Regards,

Libo


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message