spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cody Koeninger <c...@koeninger.org>
Subject UnusedStubClass in 1.3.0-rc1
Date Wed, 25 Feb 2015 15:53:05 GMT
So when building 1.3.0-rc1 I see the following warning:

[WARNING] spark-streaming-kafka_2.10-1.3.0.jar, unused-1.0.0.jar define 1
overlappping classes:

[WARNING]   - org.apache.spark.unused.UnusedStubClass


and when trying to build an assembly of a project that was previously using
1.3 snapshots without difficulty, I see the following errors:


[error] (*:assembly) deduplicate: different file contents found in the
following:

[error]
/Users/cody/.m2/repository/org/apache/spark/spark-streaming-kafka_2.10/1.3.0/spark-streaming-kafka_2.10-1.3.0.jar:org/apache/spark/unused/UnusedStubClass.class

[error]
/Users/cody/.m2/repository/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:org/apache/spark/unused/UnusedStubClass.class


This persists even after a clean / rebuild of both 1.3.0-rc1 and the
project using it.


I can just exclude that jar in the assembly definition, but is anyone else
seeing similar issues?  If so, might be worth resolving rather than make
users mess with assembly exclusions.

I see that this class was introduced a while ago, related to SPARK-3812 but
the jira issue doesn't have much detail.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message