spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benjamin Zaitlen <quasi...@gmail.com>
Subject 1.5 Build Errors
Date Tue, 08 Sep 2015 12:53:12 GMT
Hi All,

I'm trying to build a distribution off of the latest in master and I keep
getting errors on MQTT and the build fails.   I'm running the build on a
m1.large which has 7.5 GB of RAM and no other major processes are running.

MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"
> ./make-distribution.sh  --name continuum-custom-spark-1.5 --tgz -Pyarn
> -Phive -Phive-thriftserver -Phadoop-2.4 -Dhadoop.version=2.4.0



INFO] Spark Project GraphX ............................... SUCCESS [ 33.345
> s]
> [INFO] Spark Project Streaming ............................ SUCCESS [01:08
> min]
> [INFO] Spark Project Catalyst ............................. SUCCESS [01:39
> min]
> [INFO] Spark Project SQL .................................. SUCCESS [02:06
> min]
> [INFO] Spark Project ML Library ........................... SUCCESS [02:16
> min]
> [INFO] Spark Project Tools ................................ SUCCESS [
>  4.087 s]
> [INFO] Spark Project Hive ................................. SUCCESS [01:28
> min]
> [INFO] Spark Project REPL ................................. SUCCESS [
> 16.291 s]
> [INFO] Spark Project YARN Shuffle Service ................. SUCCESS [
> 13.671 s]
> [INFO] Spark Project YARN ................................. SUCCESS [
> 20.554 s]
> [INFO] Spark Project Hive Thrift Server ................... SUCCESS [
> 14.332 s]
> [INFO] Spark Project Assembly ............................. SUCCESS [03:33
> min]
> [INFO] Spark Project External Twitter ..................... SUCCESS [
> 14.208 s]
> [INFO] Spark Project External Flume Sink .................. SUCCESS [
> 11.535 s]
> [INFO] Spark Project External Flume ....................... SUCCESS [
> 19.010 s]
> [INFO] Spark Project External Flume Assembly .............. SUCCESS [
>  5.210 s]
> [INFO] Spark Project External MQTT ........................ FAILURE [01:10
> min]
> [INFO] Spark Project External MQTT Assembly ............... SKIPPED
> [INFO] Spark Project External ZeroMQ ...................... SKIPPED
> [INFO] Spark Project External Kafka ....................... SKIPPED
> [INFO] Spark Project Examples ............................. SKIPPED
> [INFO] Spark Project External Kafka Assembly .............. SKIPPED
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 22:55 min
> [INFO] Finished at: 2015-09-07T22:42:57+00:00
> [INFO] Final Memory: 240M/455M
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] GC overhead limit exceeded -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
> -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
> + return 1
> + exit 1


Any thoughts would be extremely helpful.

--Ben

Mime
View raw message