spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Or <and...@databricks.com>
Subject Re: SPARK UI - Details post job processiong
Date Thu, 25 Sep 2014 20:23:02 GMT
Hi Harsha,

You can turn on `spark.eventLog.enabled` as documented here:
http://spark.apache.org/docs/latest/monitoring.html. Then, if you are
running standalone mode, you can access the finished SparkUI through the
Master UI. Otherwise, you can start a HistoryServer to display finished UIs.

-Andrew

2014-09-25 12:55 GMT-07:00 Harsha HN <99harsha.h.n99@gmail.com>:

> Hi,
>
> Details laid out in Spark UI for the job in progress is really interesting
> and very useful.
> But this gets vanished once the job is done.
> Is there a way to get job details post processing?
>
> Looking for Spark UI data, not standard input,output and error info.
>
> Thanks,
> Harsha
>

Mime
View raw message