spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mikhailau, Alex" <Alex.Mikhai...@mlb.com>
Subject spark metrics prefix in Graphite is duplicated
Date Wed, 06 Sep 2017 21:18:18 GMT
Hi guys,

When I set up my EMR cluster with Spark I add

"*.sink.graphite.prefix": "$env.$namespace.$team.$app" to metrics.properties

The cluster comes up with correct metrics.properties

Then I simply add-step to EMR with spark-submit without any metrics namespace parameter. In
my Graphite, Spark is recording metrics with duplicate metrics prefix:

$env.$namespace.$team.$app.$env.$namespace.$team.$app

Has anyone else run into this?

Alex

Mime
View raw message