spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alex Kozlov <ale...@gmail.com>
Subject Re: How can I disable logging when running local[*]?
Date Tue, 06 Oct 2015 03:34:25 GMT
Did you try “--driver-java-options
'-Dlog4j.configuration=file:/<path-to-log4j.properties>'” and setting the
log4j.rootLogger=FATAL,console?

On Mon, Oct 5, 2015 at 8:19 PM, Jeff Jones <jjones@adaptivebiotech.com>
wrote:

> I’ve written an application that hosts the Spark driver in-process using
> “local[*]”. I’ve turned off logging in my conf/log4j.properties file. I’ve
> also tried putting the following code prior to creating my SparkContext.
> These were coupled together from various posts I’ve. None of these steps
> have worked. I’m still getting a ton of logging to the console. Anything
> else I can try?
>
> Thanks,
> Jeff
>
> private def disableLogging(): Unit = {
>   import org.apache.log4j.PropertyConfigurator
>
>   PropertyConfigurator.configure("conf/log4j.properties")
>   Logger.getRootLogger().setLevel(Level.OFF)
>   Logger.getLogger("org").setLevel(Level.OFF)
>   Logger.getLogger("akka").setLevel(Level.OFF)
> }
>
>
>
> This message (and any attachments) is intended only for the designated
> recipient(s). It
> may contain confidential or proprietary information, or have other
> limitations on use as
> indicated by the sender. If you are not a designated recipient, you may
> not review, use,
> copy or distribute this message. If you received this in error, please
> notify the sender by
> reply e-mail and delete this message.
>



-- 
Alex Kozlov
(408) 507-4987
(408) 830-9982 fax
(650) 887-2135 efax
alexvk@gmail.com

Mime
View raw message