spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: spark-submit conflicts with dependencies
Date Wed, 28 Jan 2015 05:48:04 GMT
You can add exclusion to Spark pom.xml
Here is an example (for hadoop-client which brings in hadoop-common)

diff --git a/pom.xml b/pom.xml
index 05cb379..53947d9 100644
--- a/pom.xml
+++ b/pom.xml
@@ -632,6 +632,10 @@
         <scope>${hadoop.deps.scope}</scope>
         <exclusions>
           <exclusion>
+            <groupId>commons-configuration</groupId>
+            <artifactId>commons-configuration</artifactId>
+          </exclusion>
+          <exclusion>
             <groupId>asm</groupId>
             <artifactId>asm</artifactId>
           </exclusion>

On Tue, Jan 27, 2015 at 9:33 PM, soid <soid@dicefield.com> wrote:

> I have the same problem too.
> org.apache.hadoop:hadoop-common:jar:2.4.0 brings
> commons-configuration:commons-configuration:jar:1.6 but we're using
> commons-configuration:commons 1.8
> Is there any workaround for this?
>
> Greg
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/spark-submit-conflicts-with-dependencies-tp8909p21399.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message