kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ben Davison <ben.davi...@7digital.com>
Subject Re: What is the fair setup of Kafka to be comparable with NATS or NSQ?
Date Thu, 15 Sep 2016 09:16:30 GMT
Hi Kant,

I was following the other thread, can you try using a different
benchmarking client for a test.

https://grey-boundary.io/load-testing-apache-kafka-on-aws/

Ben

On Thursday, 15 September 2016, kant kodali <kanth909@gmail.com> wrote:

> with Kafka I tried it with 10 messages with single broker and only one
> partiton
> that looked instantaneous and ~5K messages/sec for the data size of 1KB
> I tried it with 1000 messages that looked instantaneous as well ~5K
> messages/sec
> for the data size of 1KBI tried it with 10K messages with single broker
> and only
> one partiton  things started to go down ~1K messages/sec for the data size
> of
> 1KB
> having only one partition on a single broker is a bad?  My goal is to run
> some
> basic benchmarks on NATS & NSQ & KAFKA
> I have the same environment for all three (NATS & NSQ & KAFKA)
> a broker  on Machine 1producer on Machine 2Consumer on Machine 3
> with a data size of 1KB (so each message is 1KB ) and m4.xlarge aws
> instance.
> I have pushed 300K messages with NATS and it was able to handle easily and
> receive throughput was 5K messages/secI have pushed 300K messages and NSQ
> and
> receive throughput was 2K messages/secI am unable to push 300K messages
> with
> Kafka with the above configuration and environmentso at this point my
> biggest
> question is what is the fair setup for Kafka so its comparable with NATS
> and
> NSQ?
> kant

-- 


This email, including attachments, is private and confidential. If you have 
received this email in error please notify the sender and delete it from 
your system. Emails are not secure and may contain viruses. No liability 
can be accepted for viruses that might be transferred by this email or any 
attachment. Any unauthorised copying of this message or unauthorised 
distribution and publication of the information contained herein are 
prohibited.

7digital Limited. Registered office: 69 Wilson Street, London EC2A 2BB.
Registered in England and Wales. Registered No. 04843573.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message