spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: Maven out of memory error
Date Fri, 16 Jan 2015 20:06:18 GMT
Can you try doing this before running mvn ?

export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M
-XX:ReservedCodeCacheSize=512m"

What OS are you using ?

Cheers

On Fri, Jan 16, 2015 at 12:03 PM, Andrew Musselman <
andrew.musselman@gmail.com> wrote:

> Just got the latest from Github and tried running `mvn test`; is this
> error common and do you have any advice on fixing it?
>
> Thanks!
>
> [INFO] --- scala-maven-plugin:3.2.0:compile (scala-compile-first) @
> spark-core_2.10 ---
> [WARNING] Zinc server is not available at port 3030 - reverting to normal
> incremental compile
> [INFO] Using incremental compilation
> [INFO] compiler plugin:
> BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)
> [INFO] Compiling 400 Scala sources and 34 Java sources to
> /home/akm/spark/core/target/scala-2.10/classes...
> [WARNING]
> /home/akm/spark/core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala:22:
> imported `DataReadMethod' is permanently hidden by definition of object
> DataReadMethod in package executor
> [WARNING] import org.apache.spark.executor.DataReadMethod
> [WARNING]                                  ^
> [WARNING]
> /home/akm/spark/core/src/main/scala/org/apache/spark/TaskState.scala:41:
> match may not be exhaustive.
> It would fail on the following input: TASK_ERROR
> [WARNING]   def fromMesos(mesosState: MesosTaskState): TaskState =
> mesosState match {
> [WARNING]                                                          ^
> [WARNING]
> /home/akm/spark/core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala:89:
> method isDirectory in class FileSystem is deprecated: see corresponding
> Javadoc for more information.
> [WARNING]     if (!fileSystem.isDirectory(new Path(logBaseDir))) {
> [WARNING]                     ^
> [ERROR] PermGen space -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
>
>

Mime
View raw message