spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sameer Farooqui <same...@databricks.com>
Subject Re: Monitoring Spark
Date Thu, 04 Dec 2014 08:44:43 GMT
Are you running Spark in Local or Standalone mode? In either mode, you
should be able to hit port 4040 (to see the Spark
Jobs/Stages/Storage/Executors UI) on the machine where the driver is
running. However, in local mode, you won't have a Spark Master UI on 7080
or a Worker UI on 7081.

You can manually set the Spark Stages UI port to something other than 4040
(in case there are conflicts) with the spark.ui.port setting.

Also, after setting the evengLog.enabled to true, you may also want to
specificy the spark.eventLog.dir to a globally visible filesystem like HDFS
(unless you're running in local mode).

On Wed, Dec 3, 2014 at 10:01 AM, Isca Harmatz <pop1998@gmail.com> wrote:

> hello,
>
> im running spark on stand alone station and im try to view the event log
> after the run is finished
> i turned on the event log as the site said (spark.eventLog.enabled set to
> true)
>
> but i can't find the log files or get the web ui to work. any idea on how
> to do this?
>
> thanks
>    Isca
>
>

Mime
View raw message