Ah, right.  Should've caught that.

The docs seem to recommend 2gb.  Should that be increased as well?

--Ben

On Tue, Sep 8, 2015 at 9:33 AM, Sean Owen <sowen@cloudera.com> wrote:
It shows you there that Maven is out of memory. Give it more heap. I use 3gb.

On Tue, Sep 8, 2015 at 1:53 PM, Benjamin Zaitlen <quasiben@gmail.com> wrote:
> Hi All,
>
> I'm trying to build a distribution off of the latest in master and I keep
> getting errors on MQTT and the build fails.   I'm running the build on a
> m1.large which has 7.5 GB of RAM and no other major processes are running.
>
>> MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"
>> ./make-distribution.sh  --name continuum-custom-spark-1.5 --tgz -Pyarn
>> -Phive -Phive-thriftserver -Phadoop-2.4 -Dhadoop.version=2.4.0
>
>
>
>> INFO] Spark Project GraphX ............................... SUCCESS [
>> 33.345 s]
>> [INFO] Spark Project Streaming ............................ SUCCESS [01:08
>> min]
>> [INFO] Spark Project Catalyst ............................. SUCCESS [01:39
>> min]
>> [INFO] Spark Project SQL .................................. SUCCESS [02:06
>> min]
>> [INFO] Spark Project ML Library ........................... SUCCESS [02:16
>> min]
>> [INFO] Spark Project Tools ................................ SUCCESS [
>> 4.087 s]
>> [INFO] Spark Project Hive ................................. SUCCESS [01:28
>> min]
>> [INFO] Spark Project REPL ................................. SUCCESS [
>> 16.291 s]
>> [INFO] Spark Project YARN Shuffle Service ................. SUCCESS [
>> 13.671 s]
>> [INFO] Spark Project YARN ................................. SUCCESS [
>> 20.554 s]
>> [INFO] Spark Project Hive Thrift Server ................... SUCCESS [
>> 14.332 s]
>> [INFO] Spark Project Assembly ............................. SUCCESS [03:33
>> min]
>> [INFO] Spark Project External Twitter ..................... SUCCESS [
>> 14.208 s]
>> [INFO] Spark Project External Flume Sink .................. SUCCESS [
>> 11.535 s]
>> [INFO] Spark Project External Flume ....................... SUCCESS [
>> 19.010 s]
>> [INFO] Spark Project External Flume Assembly .............. SUCCESS [
>> 5.210 s]
>> [INFO] Spark Project External MQTT ........................ FAILURE [01:10
>> min]
>> [INFO] Spark Project External MQTT Assembly ............... SKIPPED
>> [INFO] Spark Project External ZeroMQ ...................... SKIPPED
>> [INFO] Spark Project External Kafka ....................... SKIPPED
>> [INFO] Spark Project Examples ............................. SKIPPED
>> [INFO] Spark Project External Kafka Assembly .............. SKIPPED
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 22:55 min
>> [INFO] Finished at: 2015-09-07T22:42:57+00:00
>> [INFO] Final Memory: 240M/455M
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] GC overhead limit exceeded -> [Help 1]
>> [ERROR]
>> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>> [ERROR]
>> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/OutOfMemoryError
>> + return 1
>> + exit 1
>
>
> Any thoughts would be extremely helpful.
>
> --Ben