spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: slf4j and log4j loop
Date Fri, 14 Mar 2014 20:32:55 GMT
Yes, I think you are interested in this issue and fix:
https://github.com/apache/spark/pull/107

--
Sean Owen | Director, Data Science | London


On Fri, Mar 14, 2014 at 1:04 PM, Adrian Mocanu <amocanu@verticalscope.com>wrote:

>  Hi
>
> Have you encountered a slf4j and log4j loop when using Spark? I pull a few
> packages via sbt.
>
> Spark package uses slf4j-log4j12.jar and another package uses use
> log4j-over-slf4j.jar which creates the circular loop between the 2 loggers
> and thus the exception below. Do you know of a fix for this?
>
>
>
>
>
> SLF4J: Detected both log4j-over-slf4j.jar AND slf4j-log4j12.jar on the
> class path, preempting StackOverflowError.
>
> SLF4J: See also http://www.slf4j.org/codes.html#log4jDelegationLoop for
> more details.
>
> An exception or error caused a run to abort.
>
> java.lang.ExceptionInInitializerError
>
>                 at org.apache.log4j.Logger.getLogger(Logger.java:40)
>
>                 at
> org.apache.spark.util.AkkaUtils$.createActorSystem(AkkaUtils.scala:58)
>
>                 at org.apache.spark.SparkEnv$.create(SparkEnv.scala:126)
>
>                 at
> org.apache.spark.SparkContext.<init>(SparkContext.scala:139)
>
>                 at
> org.apache.spark.streaming.StreamingContext$.createNewSparkContext(StreamingContext.scala:500)
>
>                 at
> org.apache.spark.streaming.StreamingContext.<init>(StreamingContext.scala:76)
>
>                 … … … … … … … … … … … … … … … …
>
> Caused by: java.lang.IllegalStateException: Detected both
> log4j-over-slf4j.jar AND slf4j-log4j12.jar on the class path, preempting
> StackOverflowError. See also
> http://www.slf4j.org/codes.html#log4jDelegationLoop for more details.
>
>                 at
> org.apache.log4j.Log4jLoggerFactory.<clinit>(Log4jLoggerFactory.java:51)
>
>                 ... 54 more
>
>
>
>
>
> Thanks
>
> -Adrian
>
>
>

Mime
View raw message