spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: Is there a way to turn on spark eventLog on the worker node?
Date Tue, 25 Nov 2014 04:13:58 GMT
Hello,

What exactly are you trying to see? Workers don't generate any events
that would be logged by enabling that config option. Workers generate
logs, and those are captured and saved to disk by the cluster manager,
generally, without you having to do anything.

On Mon, Nov 24, 2014 at 7:46 PM, Xuelin Cao <xuelincao@yahoo.com.invalid> wrote:
> Hi,
>
>     I'm going to debug some spark applications on our testing platform. And
> it would be helpful if we can see the eventLog on the worker node.
>
>     I've tried to turn on spark.eventLog.enabled and set spark.eventLog.dir
> parameters on the worker node. However, it doesn't work.
>
>     I do have event logs on my driver node, and I know how to turn it on.
> However, the same settings doesn't work on the worker node.
>
>     Can anyone help me to clarify whether event log is only available on
> driver node?
>



-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message