spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roman Pastukhov <metaignat...@gmail.com>
Subject Log analyzer and other Spark tools
Date Mon, 17 Mar 2014 14:35:34 GMT
Hi.

We're thinking about writing a tool that would read Spark logs and output
cache contents at some point in time (e.g. if you want to see what data
fills the cache and whether some of it may be unpersisted to improve
performance).

Are there similar projects that already exist? Is there a list of
Spark-related tools? There is Spark debugger/SRD (
https://github.com/mesos/spark/wiki/Spark-Debugger,
http://spark-replay-debugger-overview.readthedocs.org/en/latest/) but I
couldn't find any links to them on the Spark project site.

Mime
View raw message