kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <...@confluent.io>
Subject Re: Exception got when using csv reporter for mirror maker consumer
Date Wed, 04 Feb 2015 05:45:44 GMT
Could you try removing /var/log/kafka/csv_metrics/BytesPerSec.csv first?

Thanks,

Jun

On Tue, Feb 3, 2015 at 5:25 AM, Xiao, Luffy <Luffy.Xiao@ebay.com> wrote:

> Hi,
>
> I have checked out the trunk code and tried to use Mirror Maker.
> When I enabled the csv reporter in Mirror Maker consumer config
> (—consumer.config=c1.properties)
>
>
> kafka.metrics.polling.interval.secs=5
>
> kafka.metrics.reporters=kafka.metrics.KafkaCSVMetricsReporter
>
> kafka.csv.metrics.dir=/var/log/kafka/csv_metrics
>
> kafka.csv.metrics.reporter.enabled=true
>
> and got following exception in the log:
>
>
> [2015-02-03 05:50:30,869] WARN Property kafka.csv.metrics.dir is not valid
> (kafka.utils.VerifiableProperties)
>
> [2015-02-03 05:50:30,870] WARN Property kafka.csv.metrics.reporter.enabled
> is not valid (kafka.utils.VerifiableProperties)
>
> [2015-02-03 05:50:30,870] WARN Property
> kafka.metrics.polling.interval.secs is not valid
> (kafka.utils.VerifiableProperties)
>
> [2015-02-03 05:50:30,870] WARN Property kafka.metrics.reporters is not
> valid (kafka.utils.VerifiableProperties)
>
> [2015-02-03 05:50:31,036] WARN The configuration compression.codec = null
> was supplied but isn't a known config.
> (org.apache.kafka.clients.producer.ProducerConfig)
>
> [2015-02-03 05:50:31,036] WARN The configuration serializer.class = null
> was supplied but isn't a known config.
> (org.apache.kafka.clients.producer.ProducerConfig)
>
> [2015-02-03 05:50:31,036] WARN The configuration producer.type = null was
> supplied but isn't a known config.
> (org.apache.kafka.clients.producer.ProducerConfig)
>
> java.io.IOException: Unable to create
> /var/log/kafka/csv_metrics/BytesPerSec.csv
>
> at
> com.yammer.metrics.reporting.CsvReporter.createStreamForMetric(CsvReporter.java:141)
>
> at
> com.yammer.metrics.reporting.CsvReporter.getPrintStream(CsvReporter.java:257)
>
> at com.yammer.metrics.reporting.CsvReporter.access$000(CsvReporter.java:22)
>
> at
> com.yammer.metrics.reporting.CsvReporter$1.getStream(CsvReporter.java:156)
>
> at
> com.yammer.metrics.reporting.CsvReporter.processMeter(CsvReporter.java:173)
>
> at
> com.yammer.metrics.reporting.CsvReporter.processMeter(CsvReporter.java:22)
>
> at com.yammer.metrics.core.Meter.processWith(Meter.java:131)
>
> at com.yammer.metrics.reporting.CsvReporter.run(CsvReporter.java:163)
>
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
>
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>
> It shows that unable to create BytesPerSec.csv, but when the process
> should have write access to metrics folder.
> Any tips will be appreciated.
>
> Thanks
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message