kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: kafka producer performance test
Date Thu, 02 Oct 2014 19:56:11 GMT
Hello Sa,

KAFKA-1490 introduces a new step of downloading the wrapper, details are
included in the latest README file.

Guozhang

On Thu, Oct 2, 2014 at 11:00 AM, Sa Li <salicn@gmail.com> wrote:

> Thanks, Jay,
>
> Here is what I did this morning, I git clone the latest version of kafka
> from git, (I am currently using kafka 8.0) now it is 8.1.1, and it use
> gradle to build project. I am having trouble to build it. I installed
> gradle, and run ./gradlew jar in kafka root directory, it comes out:
> Error: Could not find or load main class
> org.gradle.wrapper.GradleWrapperMain
>
> Any idea about this.
>
> Thanks
>
> Alec
>
> On Wed, Oct 1, 2014 at 9:21 PM, Jay Kreps <jay.kreps@gmail.com> wrote:
>
> > Hi Sa,
> >
> > That script was developed with the new producer that is included on
> > trunk. Checkout trunk and build and it should be there.
> >
> > -Jay
> >
> > On Wed, Oct 1, 2014 at 7:55 PM, Sa Li <salicn@gmail.com> wrote:
> > > Hi, All
> > >
> > > I built a 3-node kafka cluster, I want to make performance test, I
> found
> > someone post following thread, that is exactly the problem I have:
> > > -------------
> > > While testing kafka producer performance, I found 2 testing scripts.
> > >
> > > 1) performance testing script in kafka distribution
> > >
> > > bin/kafka-producer-perf-test.sh --broker-list localhost:9092 --messages
> > > 10000000 --topic test --threads 10 --message-size 100 --batch-size
> 10000
> > > --compression-codec 1
> > >
> > > 2) performance testing script mentioned in
> > >
> > >
> >
> https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines
> > >
> > > bin/kafka-run-class.sh
> > > org.apache.kafka.clients.tools.ProducerPerformance test6 50000000 100
> > > -1 acks=1 bootstrap.servers=esv4-hcl198.grid.linkedin.com:9092
> > > buffer.memory=67108864 batch.size=8196
> > >
> > > based on org.apache.kafka.clients.producer.Producer.
> > >
> > > ——————
> > >
> > >
> > > I was unable to duplicate either of above method, I figure the commands
> > are outdated, anyone point me how to do such test with new command?
> > >
> > >
> > > thanks
> > >
> > > Alec
> >
>
>
>
> --
>
> Alec Li
>



-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message