spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reynold Xin <r...@apache.org>
Subject Re: suppressing logging in REPL
Date Wed, 06 Nov 2013 08:16:55 GMT
Are you sure you put the log4j file in the right place? I just tried this
with your configuration file, and this is what I see:


rxin @ rxin-air : /scratch/rxin/incubator-spark
> ./spark-shell
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 0.9.0-SNAPSHOT
      /_/

Using Scala version 2.9.3 (Java HotSpot(TM) 64-Bit Server VM, Java 1.6.0_65)
Initializing interpreter...
Creating SparkContext...
Spark context available as sc.
Type in expressions to have them evaluated.
Type :help for more information.

scala> sc.parallelize(1 to 10, 2).count
res0: Long = 10



On Tue, Nov 5, 2013 at 2:36 PM, Shay Seng <shay@1618labs.com> wrote:

> Hi,
>
> I added a log4j.properties file in <spark>/conf
> more ./spark/conf/log4j.properties
> # Set everything to be logged to the console
> log4j.rootCategory=WARN, console
> log4j.appender.console=org.apache.log4j.ConsoleAppender
> log4j.appender.console.layout=org.apache.log4j.PatternLayout
> log4j.appender.console.layout.ConversionPattern=%d{yy/MM/dd HH:mm:ss} %p
> %c{1}: %m%n
>
> # Ignore messages below warning level from Jetty, because it's a bit
> verbose
> log4j.logger.org.eclipse.jetty=WARN
>
> But yet, when I launch the REPL, I still see INFO logs... what am I
> missing here?
>
> Welcome to
>       ____              __
>      / __/__  ___ _____/ /__
>     _\ \/ _ \/ _ `/ __/  '_/
>    /___/ .__/\_,_/_/ /_/\_\   version 0.8.0
>       /_/
>
> Using Scala version 2.9.3 (OpenJDK 64-Bit Server VM, Java 1.7.0_45)
> Initializing interpreter...
> 13/11/05 22:33:11 INFO server.Server: jetty-7.x.y-SNAPSHOT
> 13/11/05 22:33:11 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:49376
> Creating SparkContext...
> 13/11/05 22:33:21 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started
> 13/11/05 22:33:21 INFO spark.SparkEnv: Registering BlockManagerMaster
> 13/11/05 22:33:21 INFO storage.MemoryStore: MemoryStore started with
> capacity 3.8 GB.
> 13/11/05 22:33:21 INFO storage.DiskStore: Created local directory at
> /mnt/spark/spark-local-20131105223321-9086
> 13/11/05 22:33:21 INFO storage.DiskStore: Created local directory at
> /mnt2/spark/spark-local-20131105223321-b94d
>

Mime
View raw message