spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tathagata Das <t...@databricks.com>
Subject Re: java.lang.IllegalArgumentException: A metric named ... already exists
Date Mon, 06 Jul 2015 08:03:43 GMT
I have already opened a JIRA about this.

https://issues.apache.org/jira/browse/SPARK-8743

On Mon, Jul 6, 2015 at 1:02 AM, Juan Rodríguez Hortalá <
juan.rodriguez.hortala@gmail.com> wrote:

> Hi,
>
> I haven't been able to reproduce the error reliably, I will open a JIRA as
> soon as I can
>
> Greetings,
>
> Juan
>
> 2015-06-23 21:57 GMT+02:00 Tathagata Das <tdas@databricks.com>:
>
>> Aaah this could be potentially major issue as it may prevent metrics from
>> restarted streaming context be not published. Can you make it a JIRA.
>>
>> TD
>>
>> On Tue, Jun 23, 2015 at 7:59 AM, Juan Rodríguez Hortalá <
>> juan.rodriguez.hortala@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm running a program in Spark 1.4 where several Spark Streaming
>>> contexts are created from the same Spark context. As pointed in
>>> https://spark.apache.org/docs/latest/streaming-programming-guide.html
>>> each Spark Streaming context is stopped before creating the next Spark
>>> Streaming context. The program works ok, but I get exceptions like the
>>> following when a new Spark Streaming context is created
>>>
>>> 15/06/23 16:34:51 INFO MetricsSystem: Metrics already registered
>>> java.lang.IllegalArgumentException: A metric named
>>> local-1435070090627.driver.SampleStreamingTest.StreamingMetrics.streaming.lastReceivedBatch_processingEndTime
>>> already exists
>>>         at
>>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91)
>>>         at
>>> com.codahale.metrics.MetricRegistry.registerAll(MetricRegistry.java:385)
>>>         at
>>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:85)
>>>
>>>
>>> Is this something to be concerned, or just a minor nuisance?
>>>
>>> Thanks a lot in advance.
>>>
>>> Greetings,
>>>
>>> Juan Rodriguez Hortala
>>>
>>
>>
>

Mime
View raw message