spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Azuryy Yu <azury...@gmail.com>
Subject Re: Build Spark with maven
Date Mon, 09 Dec 2013 02:14:33 GMT
Hi Mark,

I build the current releast candidate,
It complained during build:
Downloading:
http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.0.5/akka-actor-2.0.5.pom
[WARNING] The POM for com.typesafe.akka:akka-actor:jar:2.0.5 is missing, no
dependency information available
Downloading:
http://repo1.maven.org/maven2/com/typesafe/akka/akka-remote/2.0.5/akka-remote-2.0.5.pom
[WARNING] The POM for com.typesafe.akka:akka-remote:jar:2.0.5 is missing,
no dependency information available
Downloading:
http://repo1.maven.org/maven2/com/typesafe/akka/akka-slf4j/2.0.5/akka-slf4j-2.0.5.pom
[WARNING] The POM for com.typesafe.akka:akka-slf4j:jar:2.0.5 is missing, no
dependency information available
Downloading:
http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.0.5/akka-actor-2.0.5.jar
Downloading:
http://repo1.maven.org/maven2/com/typesafe/akka/akka-remote/2.0.5/akka-remote-2.0.5.jar
Downloading:
http://repo1.maven.org/maven2/com/typesafe/akka/akka-slf4j/2.0.5/akka-slf4j-2.0.5.jar



then, throw Error:
[ERROR] Failed to execute goal on project spark-core_2.9.3: Could not
resolve dependencies for project
org.apache.spark:spark-core_2.9.3:jar:0.8.1-incubating: The following
artifacts could not be resolved: com.typesafe.akka:akka-actor:jar:2.0.5,
com.typesafe.akka:akka-remote:jar:2.0.5,
com.typesafe.akka:akka-slf4j:jar:2.0.5: Could not find artifact
com.typesafe.akka:akka-actor:jar:2.0.5 in maven-nexus (
http://repo1.maven.org/maven2/) -> [Help 1]



I checked on the http://repo1.maven.org/maven2, there is no akka-*  2.0.5,
and there is no URL such as '
http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor/2.0.5', it's
http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor_'VERSION'/<http://repo1.maven.org/maven2/com/typesafe/akka/akka-actor_2.10/>



On Mon, Dec 9, 2013 at 9:54 AM, Azuryy Yu <azuryyyu@gmail.com> wrote:

> Thanks Mark, I will.
>
>
> On Mon, Dec 9, 2013 at 9:53 AM, Mark Hamstra <mark@clearstorydata.com>wrote:
>
>> You probably want to try the current release candidate:
>> https://github.com/apache/incubator-spark/archive/v0.8.1-incubating.tar.gz
>>
>>
>> On Sun, Dec 8, 2013 at 5:51 PM, Azuryy Yu <azuryyyu@gmail.com> wrote:
>>
>>> Thanks Matei, I'll try.
>>>
>>> @Mark, I download source package from
>>> http://spark-project.org/download/spark-0.8.0-incubating.tgz, Sorry, I
>>> build 0.8.0. not 0.8.1.
>>>
>>>
>>> On Mon, Dec 9, 2013 at 9:31 AM, Mark Hamstra <mark@clearstorydata.com>wrote:
>>>
>>>> There is no released source package of Spark 0.8.1.  It's just gone
>>>> into release candidate in the past day.  Is that what you are trying to
>>>> build?  It should be exactly the same as what I just checked out from the
>>>> v0.8.1-incubating tag.
>>>>
>>>>
>>>> On Sun, Dec 8, 2013 at 5:28 PM, Azuryy Yu <azuryyyu@gmail.com> wrote:
>>>>
>>>>> I am not check out from repository, I download source package and
>>>>> build.
>>>>>  On 2013-12-09 9:22 AM, "Mark Hamstra" <mark@clearstorydata.com>
>>>>> wrote:
>>>>>
>>>>>> I don't believe that is true of the Spark 0.8.1 code.  I just got
>>>>>> done building Spark from the v0.8.1-incubating tag after first removing
>>>>>> anything to do with akka from my ~/.m2/repository.  After a successful
>>>>>> build without incident, my local repo now only contains akka 2.0.5
packages
>>>>>> within the com/typesafe/akka subtree.
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Sun, Dec 8, 2013 at 5:01 PM, Azuryy Yu <azuryyyu@gmail.com>
wrote:
>>>>>>
>>>>>>> I build 0.8.1, maven try to download akka-actor-2.0.1, which
is used
>>>>>>> by scala-core-io.
>>>>>>>  On 2013-12-09 8:40 AM, "Matei Zaharia" <matei.zaharia@gmail.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Which version of Spark are you building? AFAIK it should
be using
>>>>>>>> Akka 2.0.5, not 2.0.1.
>>>>>>>>
>>>>>>>> Matei
>>>>>>>>
>>>>>>>> On Dec 8, 2013, at 3:35 PM, Azuryy Yu <azuryyyu@gmail.com>
wrote:
>>>>>>>>
>>>>>>>> any thoughs here? I still cannot compile spark using maven,
thanks
>>>>>>>> for any inputs.
>>>>>>>>  On 2013-12-07 2:31 PM, "Azuryy Yu" <azuryyyu@gmail.com>
wrote:
>>>>>>>>
>>>>>>>>> Hey dears,
>>>>>>>>>
>>>>>>>>> Can you give me a maven repo, so I can compile Spark
with Maven.
>>>>>>>>>
>>>>>>>>> I'm using http://repo1.maven.org/maven2/ currently
>>>>>>>>>
>>>>>>>>> but It complains cannot find akka-actor-2.0.1,  I searched
on the
>>>>>>>>> repo1.maven, and I am also cannot find akka-actor-2.0.1,
which is too old.
>>>>>>>>>
>>>>>>>>> another strange output I can see:
>>>>>>>>> <scala.version>2.9.3</scala.version>  in
the pom,
>>>>>>>>> but Maven download scala-2.9.2 during compile, why is
that?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>
>>>>
>>>
>>
>

Mime
View raw message