spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: how to set log level of spark executor on YARN(using yarn-cluster mode)
Date Thu, 16 Oct 2014 01:45:07 GMT
Hi Eric,

Check the "Debugging Your Application" section at:
http://spark.apache.org/docs/latest/running-on-yarn.html

Long story short: upload your log4j.properties using the "--files"
argument of spark-submit.

(Mental note: we could make the log level configurable via a system property...)


On Wed, Oct 15, 2014 at 5:58 PM, eric wong <win19999@gmail.com> wrote:
> Hi,
>
> I want to check the DEBUG log of spark executor on YARN(using yarn-cluster
> mode), but
>
> 1. yarn daemonlog setlevel DEBUG YarnChild.class
> 2. set log4j.properties in spark/conf folder on client node.
>
> no means above works.
>
> So how could i set the  log level of spark executor on YARN container to
> DEBUGļ¼Ÿ
>
> Thanks!
>
>
>
>
> --
> Wang Haihua
>



-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message