spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: Maven out of memory error
Date Fri, 16 Jan 2015 20:06:15 GMT
Hey Andrew, you'll want to have a look at the Spark docs on building:
http://spark.apache.org/docs/latest/building-spark.html

It's the first thing covered there.

The warnings are normal as you are probably building with newer Hadoop
profiles and so old-Hadoop support code shows deprecation warnings on
its use of old APIs.

On Fri, Jan 16, 2015 at 8:03 PM, Andrew Musselman
<andrew.musselman@gmail.com> wrote:
> Just got the latest from Github and tried running `mvn test`; is this error
> common and do you have any advice on fixing it?
>
> Thanks!
>
> [INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
> spark-core_2.10 ---
> [WARNING] Zinc server is not available at port 3030 - reverting to normal
> incremental compile
> [INFO] Using incremental compilation
> [INFO] compiler plugin:
> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
> [INFO] Compiling 400 Scala sources and 34 Java sources to
> /home/akm/spark/core/target/scala-2.10/classes...
> [WARNING]
> /home/akm/spark/core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala:22:
> imported `DataReadMethod' is permanently hidden by definition of object
> DataReadMethod in package executor
> [WARNING] import org.apache.spark.executor.DataReadMethod
> [WARNING]                                  ^
> [WARNING]
> /home/akm/spark/core/src/main/scala/org/apache/spark/TaskState.scala:41:
> match may not be exhaustive.
> It would fail on the following input: TASK_ERROR
> [WARNING]   def fromMesos(mesosState: MesosTaskState): TaskState =
> mesosState match {
> [WARNING]                                                          ^
> [WARNING]
> /home/akm/spark/core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala:89:
> method isDirectory in class FileSystem is deprecated: see corresponding
> Javadoc for more information.
> [WARNING]     if (!fileSystem.isDirectory(new Path(logBaseDir))) {
> [WARNING]                     ^
> [ERROR] PermGen space -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message