spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Utkarsh Sengar <>
Subject Exclude slf4j-log4j12 from the classpath via spark-submit
Date Mon, 24 Aug 2015 21:50:33 GMT
Continuing this discussion:

I am getting this error when I use logback-classic.

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
SLF4J: Found binding in

I need to use logback-classic for my current project, so I am trying to
ignore "slf4j-log4j12" from spark:

Now, when I run my job from Intellij (which sets the classpath), things
work perfectly.

But when I run my job via spark-submit:
~/spark-1.4.1-bin-hadoop2.4/bin/spark-submit --class runner.SparkRunner
My job fails because spark-submit sets up the classpath and it re-adds the

I am not adding spark jar to the uber-jar via the maven assembly plugin:

So how can I exclude "slf4j-log4j12.jar" when I submit a job via
spark-submit (on a per job basis)?


View raw message