kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xinyi Su <xiny...@gmail.com>
Subject Re: Kafka producer perf script throw java.io.IOException
Date Thu, 05 Feb 2015 07:19:41 GMT
Hi,

I need to get more metrics from csv reporter.  If turn off csv-reporter,
few output is shown.

Thanks.
Xinyi

On 5 February 2015 at 13:09, tao xiao <xiaotao183@gmail.com> wrote:

> Hi,
>
> In order to get it work you can turn off csv-reporter.
>
> On Thu, Feb 5, 2015 at 1:06 PM, Xinyi Su <xinyisu@gmail.com> wrote:
>
> > Hi,
> >
> > Today I updated Kafka cluster from 0.8.2-beta to 0.8.2.0 and run kafka
> > producer performance test.
> >
> > The test cannot continue because of some exceptions thrown which does not
> > occur at 0.8.2-beta. My perf library is kafka-perf_2.9.2-0.8.0.jar which
> is
> > the latest version on maven repository.
> >
> > -bash-4.1$ bin/kafka-producer-perf-test.sh   --broker-list <broker list>
> > --topics PerfTopic22 --sync --initial-message-id 1 --messages 200000
> > --csv-reporter-enabled --metrics-dir /tmp/PerfTopic22_1
> > --message-send-gap-ms 20 --request-num-acks -1 --batch-size 1
> >
> > java.io.IOException: Unable to create
> > /tmp/PerfTopic22_1/ProducerRequestSize.csv
> > at
> >
> >
> com.yammer.metrics.reporting.CsvReporter.createStreamForMetric(CsvReporter.java:141)
> > at
> >
> >
> com.yammer.metrics.reporting.CsvReporter.getPrintStream(CsvReporter.java:257)
> > at
> com.yammer.metrics.reporting.CsvReporter.access$000(CsvReporter.java:22)
> > at
> >
> com.yammer.metrics.reporting.CsvReporter$1.getStream(CsvReporter.java:156)
> > at
> >
> >
> com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:194)
> > at
> >
> >
> com.yammer.metrics.reporting.CsvReporter.processHistogram(CsvReporter.java:22)
> > at com.yammer.metrics.core.Histogram.processWith(Histogram.java:231)
> > at com.yammer.metrics.reporting.CsvReporter.run(CsvReporter.java:163)
> > at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
> > at
> >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
> > at
> >
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> >
>
>
>
> --
> Regards,
> Tao
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message