kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Neal <cwn...@gmail.com>
Subject kafka-producer-perf-test.sh help please
Date Fri, 23 May 2014 19:17:21 GMT
Hi everyone.

Looking for some help running the Kafka performance testing shell script.
First got the NoClassDefFound error, and then built from src from these

wget http://archive.apache.org/dist/kafka/
tar -xvf kafka-
cd kafka-
sbt update
sbt package
sbt assembly-package-dependency

The 'sbt assembly-package-dependency' gave this error:

cneal@chriss-mbp[574]:~/workspace/kafka-> sbt
[info] Set current project to kafka-0-8-1-1-src (in build
[error] Not a valid command: assembly-package-dependency
[error] Not a valid project ID: assembly-package-dependency
[error] Expected ':' (if selecting a configuration)
[error] Not a valid key: assembly-package-dependency (similar:
[error] assembly-package-dependency

I tried running the suggested 'sbt-dependency' and got this:

cneal@chriss-mbp[579]:~/workspace/kafka-> sbt sbt-dependency
[info] Set current project to kafka-0-8-1-1-src (in build
[info] org.scala-sbt:sbt:0.13.2

...which sure didn't seem like it did anything.  I'm running sbt-0.13.2 on
a Mac.

But I still found this JAR file that seemed to have the classes required:

ls -l
total 2800
-rw-r--r--@ 1 cneal  staff  1306797 Apr 22 18:37 kafka-0.7.0.jar
*-rw-r--r--@ 1 cneal  staff    55427 Apr 22 18:37 kafka-perf-0.7.0.jar*
-rw-r--r--@ 1 cneal  staff    62913 Apr 22 18:37 zkclient-0.1.jar

But then when I run the .sh scripts as follows, I get yet another exception:

   bin/kafka-producer-perf-test.sh --brokerinfo zk.connect=$ZOOKEEPER
--topic test_input  --async --threads 2 --messages 100000

start.time, end.time, compression, message.size, batch.size,
total.data.sent.in.MB, MB.sec, total.data.sent.in.nMsg, nMsg.sec
Exception in thread "main" java.lang.NoSuchMethodError:
at kafka.perf.ProducerPerformance$.main(ProducerPerformance.scala:57)
at kafka.perf.ProducerPerformance.main(ProducerPerformance.scala)

Can someone please shed some light on how to get this to run?

Most appreciated,


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message