spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ankur Dave <ankurd...@gmail.com>
Subject Compiling Spark master (284771ef) with sbt/sbt assembly fails on EC2
Date Fri, 01 Aug 2014 10:42:17 GMT
Attempting to build Spark from source on EC2 using sbt gives the error "sbt.ResolveException:
unresolved dependency: org.scala-lang#scala-library;2.10.2: not found". This only seems to
happen on EC2, not on my local machine.

To reproduce, launch a cluster using spark-ec2, clone the Spark repository, and run sbt/sbt
assembly. A complete transcript is at https://gist.github.com/ankurdave/bb96ea237700f5cd670c.
Here is an excerpt with the error:

    [info] Resolving org.scala-lang#scala-library;2.10.2 ...
    [warn]  module not found: org.scala-lang#scala-library;2.10.2
    [...]
    [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
    [warn]  ::          UNRESOLVED DEPENDENCIES         ::
    [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
    [warn]  :: org.scala-lang#scala-library;2.10.2: not found
    [warn]  ::::::::::::::::::::::::::::::::::::::::::::::
    sbt.ResolveException: unresolved dependency: org.scala-lang#scala-library;2.10.2: not
found
            at sbt.IvyActions$.sbt$IvyActions$$resolve(IvyActions.scala:217)
    [...]
    [error] (*:update) sbt.ResolveException: unresolved dependency: org.scala-lang#scala-library;2.10.2:
not found
    Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore?

After a bisection, it seems the problem was introduced by the SBT-Maven change (628932b) [1,
2].

Ankur

[1] https://github.com/apache/spark/pull/772
[2] https://issues.apache.org/jira/browse/SPARK-1776

Mime
View raw message