spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-1844) Support maven-style dependency resolution in sbt build
Date Fri, 23 Jan 2015 13:52:34 GMT


Sean Owen commented on SPARK-1844:

Is this still relevant now that Maven is the primary build? the SBT build appears close-enough
to the Maven build to support development.

> Support maven-style dependency resolution in sbt build
> ------------------------------------------------------
>                 Key: SPARK-1844
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>            Reporter: Patrick Wendell
>            Assignee: Prashant Sharma
> [Currently this is a brainstorm/wish - not sure it's possible]
> Ivy/sbt and maven use fundamentally different strategies when transitive dependencies
conflict (i.e. when we have two copies of library Y in our dependency graph on different versions).
> This actually means our sbt and maven builds have been divergent for a long time.
> Ivy/sbt have a pluggable notion of a [conflict manager|].
The default chooses the newest version of the dependency. SBT [allows this to be changed|;ConflictManager]
> Maven employs the [nearest wins|]
policy which means the version closes to the project root is chosen.
> It would be nice to be able to have matching semantics in the builds. We could do this
by writing a conflict manger in sbt that mimics Maven's behavior. The fact that IVY-813 has
existed for 6 years without anyone doing this makes me wonder if that is not possible or very
hard :P

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message