spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tomer Benyamini <tomer....@gmail.com>
Subject Re: custom spark app name in yarn-cluster mode
Date Thu, 11 Dec 2014 18:28:55 GMT
On Thu, Dec 11, 2014 at 8:27 PM, Tomer Benyamini <tomer.ben@gmail.com>
wrote:

> Hi,
>
> I'm trying to set a custom spark app name when running a java spark app in
> yarn-cluster mode.
>
>  SparkConf sparkConf = new SparkConf();
>
>  sparkConf.setMaster(System.getProperty("spark.master"));
>
>  sparkConf.setAppName("myCustomName");
>
>  sparkConf.set("spark.logConf", "true");
>
>  JavaSparkContext sc = new JavaSparkContext(sparkConf);
>
>
> Apparently this only works when running in yarn-client mode; in
> yarn-cluster mode the app name is the class name, when viewing the app in
> the cluster manager UI. Any idea?
>
>
> Thanks,
>
> Tomer
>
>
>

Mime
View raw message