spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject Spark on scala 2.11 build fails due to incorrect jline dependency in REPL
Date Sun, 16 Aug 2015 18:12:23 GMT
I am building spark with the following options - most notably the
**scala-2.11**:

 . dev/switch-to-scala-2.11.sh
    mvn -Phive -Pyarn -Phadoop-2.6 -Dhadoop2.6.2 -Pscala-2.11 -DskipTests
-Dmaven.javadoc.skip=true clean package


The build goes pretty far but fails in one of the minor modules *repl*:

    [INFO]
------------------------------------------------------------------------
    [ERROR] Failed to execute goal on project spark-repl_2.11: Could not
resolve dependencies
    for project org.apache.spark:spark-repl_2.11:jar:1.5.0-SNAPSHOT:
     Could not   find artifact org.scala-lang:jline:jar:2.11.7 in central
     (https://repo1.maven.org/maven2) -> [Help 1]

Upon investigation - from 2.11.5 and later the scala version of jline is no
longer required: they use the default jline distribution.

And in fact the repl only shows dependency on jline for the 2.10.4 scala
version:

    <profile>
      <id>scala-2.10</id>
      <activation>
        <property><name>!scala-2.11</name></property>
      </activation>
      <properties>
        <scala.version>2.10.4</scala.version>
        <scala.binary.version>2.10</scala.binary.version>
        <jline.version>${scala.version}</jline.version>
        <jline.groupid>org.scala-lang</jline.groupid>
      </properties>
      <dependencyManagement>
        <dependencies>
          <dependency>
            <groupId>${jline.groupid}</groupId>
            <artifactId>jline</artifactId>
            <version>${jline.version}</version>
          </dependency>
        </dependencies>
      </dependencyManagement>
    </profile>

So then it is not clear why this error is occurring. Pointers appreciated.

Mime
View raw message