kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hawin Jiang <hawin.ji...@gmail.com>
Subject Re: Kafka bottleneck issue
Date Fri, 03 Jul 2015 01:32:58 GMT
Hi Aditya

Yes. I have a single producer thread.  I used example code to test it.
I started a producer thread and sent messages to producer for one minutes.
if I start two producer thread. I will receive around 8000 TPS(
Transactions per second).
I just don't want to start many threads to receive high TPS.
Thanks.



Best regards
Hawin

On Thu, Jul 2, 2015 at 6:26 PM, Aditya Auradkar <
aauradkar@linkedin.com.invalid> wrote:

> Do you have a single producer thread? Also, how do you calculate the TPS
> (is it transactions per second?) ?
>
> Aditya
>
> ________________________________________
> From: Hawin Jiang [hawin.jiang@gmail.com]
> Sent: Thursday, July 02, 2015 5:58 PM
> To: users@kafka.apache.org
> Subject: Kafka bottleneck issue
>
> Hi Admin
>
> I have executed a performance test on one single node.The TPS never over
> 4000 events per sec on one producer.Please help me.
> Thanks in advance.
>
>
> Here is my code and configuration
>
> *********************Producer code***************************************
> public void run() {
>     int messageNo = 1;
>     while(true)
>     {
>       String messageStr = new String("Message_" + messageNo);
>       producer.send(new KeyedMessage<Integer, String>(topic, messageStr));
>       messageNo++;
>     }
>   }
>
>
>
> ************************server.properties***********************************
> broker.id=1
> port=9092
> host.name=192.168.0.112
> num.network.threads=8
> num.io.threads=8
> socket.send.buffer.bytes=1048576
> socket.receive.buffer.bytes=1048576
> socket.request.max.bytes=104857600
> log.dirs=/tmp/kafka-logs
> num.partitions=1
> num.recovery.threads.per.data.dir=1
> #log.flush.interval.ms=1000
> log.retention.hours=168
> #log.retention.bytes=1073741824
> log.segment.bytes=1073741824
> log.retention.check.interval.ms=300000
> log.cleaner.enable=false
> zookeeper.connect=192.168.0.112:2181
> zookeeper.connection.timeout.ms=6000
> zookeeper.properties
>
> ***************************************************************************************
>
>
> *************************************
> zookeeper.properties***************************
> dataDir=/tmp/zookeeper
> clientPort=2181
> maxClientCnxns=0
>
> ****************************************************************************************
>
>
>
>
> Best regards
> Hawin
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message