spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saikat Kanjilal <sxk1...@hotmail.com>
Subject Re: Spark Job Performance monitoring approaches
Date Thu, 16 Feb 2017 16:32:41 GMT
There's also this:

https://github.com/databricks/spark-perf

[https://avatars2.githubusercontent.com/u/4998052?v=3&s=400]<https://github.com/databricks/spark-perf>

GitHub - databricks/spark-perf: Performance tests for Spark<https://github.com/databricks/spark-perf>
github.com
Sweeps sets of parameters to test against multiple Spark and test configurations. Automatically
downloads and builds Spark: Maintains a cache of successful builds to ...


Not sure if it exactly fits what you are looking for but hoping it helps


________________________________
From: Chetan Khatri <chetan.opensource@gmail.com>
Sent: Wednesday, February 15, 2017 11:24 PM
To: Georg Heiler
Cc: Spark Dev List; user
Subject: Re: Spark Job Performance monitoring approaches

Thank you Georg

On Thu, Feb 16, 2017 at 12:30 PM, Georg Heiler <georg.kf.heiler@gmail.com<mailto:georg.kf.heiler@gmail.com>>
wrote:
I know of the following tools
https://sites.google.com/site/sparkbigdebug/home https://engineering.linkedin.com/blog/2016/04/dr-elephant-open-source-self-serve-performance-tuning-hadoop-spark
https://github.com/SparkMonitor/varOne https://github.com/groupon/sparklint

Chetan Khatri <chetan.opensource@gmail.com<mailto:chetan.opensource@gmail.com>>
schrieb am Do., 16. Feb. 2017 um 06:15 Uhr:
Hello All,

What would be the best approches to monitor Spark Performance, is there any tools for Spark
Job Performance monitoring ?

Thanks.


Mime
View raw message