spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jey Kottalam <...@cs.berkeley.edu>
Subject Re: N00b alert - spark-ec2 script failure
Date Fri, 13 Sep 2013 15:05:17 GMT
Hi Venkat,

The 0.8.0 branch has not yet been released (and furthermore, the
0.8.0-SNAPSHOT version refers to a prerelease build). You can install
Spark 0.8.0-SNAPSHOT to your local repository by checking out the
latest source code from http://github.com/mesos/spark and running:

    sbt/sbt publish-local

If you are using Hadoop, specify the Hadoop version required as follows:

   SPARK_HADOOP_VERSION=1.0.4 sbt/sbt publish-local

Hope that helps,
-Jey

On Thu, Sep 12, 2013 at 10:09 PM, Venkat Krishnamurthy
<venkat@yarcdata.com> wrote:
> All
>
> Apologies if this post is misdirected. I'm trying to get started with Spark,
> and using the AMPLab hands-on as a guide – The set up went as far as
> creating and spinning up the AMI's, but part way through is this dependency
> resolution error from sbt:
>
> Seems simple enough, but the failed dependency is spark-core… which I assume
> is An Important Thing.
>
> I'm hoping this is embarrassingly obvious to find and fix (or ignore) - any
> pointers?
>
> -----
>
> [warn] module not found: org.apache.spark#spark-core_2.9.3;0.8.0-SNAPSHOT
> [warn] ==== local: tried
> [warn]
> /root/.ivy2/local/org.apache.spark/spark-core_2.9.3/0.8.0-SNAPSHOT/ivys/ivy.xml
> [warn] ==== Typesafe Repository: tried
> [warn]
> http://repo.typesafe.com/typesafe/releases/org/apache/spark/spark-core_2.9.3/0.8.0-SNAPSHOT/spark-core_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== JBoss Repository: tried
> [warn]
> http://repository.jboss.org/nexus/content/repositories/releases/org/apache/spark/spark-core_2.9.3/0.8.0-SNAPSHOT/spark-core_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== Spray Repository: tried
> [warn]
> http://repo.spray.cc/org/apache/spark/spark-core_2.9.3/0.8.0-SNAPSHOT/spark-core_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== Cloudera Repository: tried
> [warn]
> https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/spark/spark-core_2.9.3/0.8.0-SNAPSHOT/spark-core_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== Local Maven: tried
> [warn]
> file:/root/.m2/repository/org/apache/spark/spark-core_2.9.3/0.8.0-SNAPSHOT/spark-core_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== public: tried
> [warn]
> http://repo1.maven.org/maven2/org/apache/spark/spark-core_2.9.3/0.8.0-SNAPSHOT/spark-core_2.9.3-0.8.0-SNAPSHOT.pom
> [info] Resolving org.apache.spark#spark-repl_2.9.3;0.8.0-SNAPSHOT ...
> [warn] module not found: org.apache.spark#spark-repl_2.9.3;0.8.0-SNAPSHOT
> [warn] ==== local: tried
> [warn]
> /root/.ivy2/local/org.apache.spark/spark-repl_2.9.3/0.8.0-SNAPSHOT/ivys/ivy.xml
> [warn] ==== Typesafe Repository: tried
> [warn]
> http://repo.typesafe.com/typesafe/releases/org/apache/spark/spark-repl_2.9.3/0.8.0-SNAPSHOT/spark-repl_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== JBoss Repository: tried
> [warn]
> http://repository.jboss.org/nexus/content/repositories/releases/org/apache/spark/spark-repl_2.9.3/0.8.0-SNAPSHOT/spark-repl_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== Spray Repository: tried
> [warn]
> http://repo.spray.cc/org/apache/spark/spark-repl_2.9.3/0.8.0-SNAPSHOT/spark-repl_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== Cloudera Repository: tried
> [warn]
> https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/spark/spark-repl_2.9.3/0.8.0-SNAPSHOT/spark-repl_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== Local Maven: tried
> [warn]
> file:/root/.m2/repository/org/apache/spark/spark-repl_2.9.3/0.8.0-SNAPSHOT/spark-repl_2.9.3-0.8.0-SNAPSHOT.pom
> [warn] ==== public: tried
> [warn]
> http://repo1.maven.org/maven2/org/apache/spark/spark-repl_2.9.3/0.8.0-SNAPSHOT/spark-repl_2.9.3-0.8.0-SNAPSHOT.pom
> [info] Resolving org.scala-tools.testing#test-interface;0.5 ...
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] ::          UNRESOLVED DEPENDENCIES         ::
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] :: org.apache.spark#spark-core_2.9.3;0.8.0-SNAPSHOT: not found
> [warn] :: org.apache.spark#spark-repl_2.9.3;0.8.0-SNAPSHOT: not found
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> sbt.ResolveException: unresolved dependency:
> org.apache.spark#spark-core_2.9.3;0.8.0-SNAPSHOT: not found
>

Mime
View raw message