spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <>
Subject Re: Spark UI and running spark-submit with --master yarn
Date Mon, 02 Mar 2015 23:50:58 GMT
What are you calling "<masternode>"? In yarn-cluster mode, the driver
is running somewhere in your cluster, not on the machine where you run

The easiest way to get to the Spark UI when using Yarn is to use the
Yarn RM's web UI. That will give you a link to the application's UI
regardless of whether it's running on client or cluster mode.

On Mon, Mar 2, 2015 at 3:39 PM, Anupama Joshi <> wrote:
> Hi ,
>  When I run my application with --master yarn-cluster or --master yarn
> --deploy-mode cluster , I can not  the spark UI at the  location --
> <masternode>:4040Even if I am running the job , I can not see teh SPARK UI.
> When I run with --master yarn --deploy-mode client  -- I see the Spark UI
> but I cannot see my job  running.
> When I run spark-submit with --master local[*] , I see the spark UI , my job
> everything (Thats great)
> Do I need to do some settings to see the UI?
> Thanks
> -AJ


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message