spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shao, Saisai" <>
Subject RE: Monitoring Spark with Graphite and Grafana
Date Fri, 27 Feb 2015 02:25:35 GMT
Cool, great job☺.


From: Ryan Williams []
Sent: Thursday, February 26, 2015 6:11 PM
To: user;
Subject: Monitoring Spark with Graphite and Grafana

If anyone is curious to try exporting Spark metrics to Graphite, I just published a post about
my experience doing that, building dashboards in Grafana<>, and using
them to monitor Spark jobs:

Code for generating Grafana dashboards tailored to the metrics emitted by Spark is here:

If anyone else is interested in working on expanding MetricsSystem to make this sort of thing
more useful, let me know, I've been working on it a fair amount and have a bunch of ideas
about where it should go.



  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message