There's also SPM for Spark -- http://sematext.com/spm/integrations/spark-monitoring.html

SPM graphs all Spark metrics and gives you alerting, anomaly detection, etc. and if you ship your Spark and/or other logs to Logsene - http://sematext.com/logsene - you can correlate metrics, logs, errors, etc.  I haven't used SPM with Spark after "AppMap" was introduced (see http://blog.sematext.com/2015/08/06/introducing-appmap/ ) but I imagine it would be nice to see a map of Spark nodes talking to each other.

Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/

On Mon, Sep 28, 2015 at 7:52 PM, Siva <sbhavanari@gmail.com> wrote:

Could someone recommend the monitoring tools for spark streaming?

By extending StreamingListener we can dump the delay in processing of batches and some alert messages. 

But are there any Web UI tools where we can monitor failures, see delays in processing, error messages and setup alerts etc.