spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Silvio Fiorito <silvio.fior...@granturing.com>
Subject RE: Spark Metrics : Why is the Sink class declared private[spark] ?
Date Sat, 02 Apr 2016 14:33:45 GMT
In the meantime you can simply define your custom metric source in the org.apache.spark package.


From: Walid Lezzar<mailto:walezz89@gmail.com>
Sent: Saturday, April 2, 2016 4:23 AM
To: Saisai Shao<mailto:sai.sai.shao@gmail.com>
Cc: spark users<mailto:user@spark.apache.org>
Subject: Re: Spark Metrics : Why is the Sink class declared private[spark] ?

This is great ! Hope this jira will be resolved for the next version of spark

Thanks.

Le 2 avr. 2016 ? 01:07, Saisai Shao <sai.sai.shao@gmail.com<mailto:sai.sai.shao@gmail.com>>
a ?crit :

There's a JIRA (https://issues.apache.org/jira/browse/SPARK-14151) about it, please take a
look.

Thanks
Saisai

On Sat, Apr 2, 2016 at 6:48 AM, Walid Lezzar <walezz89@gmail.com<mailto:walezz89@gmail.com>>
wrote:
Hi,

I looked into the spark code at how spark report metrics using the MetricsSystem class. I've
seen that the spark MetricsSystem class when instantiated parses the metrics.properties file,
tries to find the sinks class name and load them dinamically. It would be great to implement
my own sink by inheriting from the org.apache.spark.metrics.sinks.Sink class but unfortunately,
this class has been declared private[spark] ! So it is not possible to inverit from it ! Why
is that ? Is this gonna change in future spark versions ?
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<mailto:user-unsubscribe@spark.apache.org>
For additional commands, e-mail: user-help@spark.apache.org<mailto:user-help@spark.apache.org>



Mime
View raw message