spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject Re: Required file not found in building
Date Tue, 02 Dec 2014 03:02:30 GMT
Mac as well.  Just found the problem:  I had created an alias to zinc a
couple of months back. Apparently that is not happy with the build anymore.
No problem now that the issue has been isolated - just need to fix my zinc
alias.

2014-12-01 18:55 GMT-08:00 Ted Yu <yuzhihong@gmail.com>:

> I tried the same command on MacBook and didn't experience the same error.
>
> Which OS are you using ?
>
> Cheers
>
> On Mon, Dec 1, 2014 at 6:42 PM, Stephen Boesch <javadba@gmail.com> wrote:
>
>> It seems there were some additional settings required to build spark now .
>> This should be a snap for most of you ot there about what I am missing.
>> Here is the command line I have traditionally used:
>>
>>    mvn -Pyarn -Phadoop-2.3 -Phive install compile package -DskipTests
>>
>> That command line is however failing with the lastest from HEAD:
>>
>> INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
>> spark-network-common_2.10 ---
>> [INFO] Using zinc server for incremental compilation
>> [INFO] compiler plugin:
>> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
>>
>> *[error] Required file not found: scala-compiler-2.10.4.jar*
>>
>> *[error] See zinc -help for information about locating necessary files*
>>
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Spark Project Parent POM .......................... SUCCESS
>> [4.077s]
>> [INFO] Spark Project Networking .......................... FAILURE
>> [0.445s]
>>
>>
>> OK let's try "zinc -help":
>>
>> 18:38:00/spark2 $*zinc -help*
>> Nailgun server running with 1 cached compiler
>>
>> Version = 0.3.5.1
>>
>> Zinc compiler cache limit = 5
>> Resident scalac cache limit = 0
>> Analysis cache limit = 5
>>
>> Compiler(Scala 2.10.4) [74ff364f]
>> Setup = {
>> *   scala compiler =
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar*
>>    scala library =
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-library/2.10.4/scala-library-2.10.4.jar
>>    scala extra = {
>>
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-reflect/2.10.4/scala-reflect-2.10.4.jar
>>       /shared/zinc-0.3.5.1/lib/scala-reflect.jar
>>    }
>>    sbt interface = /shared/zinc-0.3.5.1/lib/sbt-interface.jar
>>    compiler interface sources =
>> /shared/zinc-0.3.5.1/lib/compiler-interface-sources.jar
>>    java home =
>>    fork java = false
>>    cache directory = /Users/steve/.zinc/0.3.5.1
>> }
>>
>> Does that compiler jar exist?  Yes!
>>
>> 18:39:34/spark2 $ll
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>> -rw-r--r--  1 steve  staff  14445780 Apr  9  2014
>>
>> /Users/steve/.m2/repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message