spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Allen Chang <>
Subject Re: Using Spark on Data size larger than Memory size
Date Wed, 11 Jun 2014 23:54:07 GMT
Thanks. We've run into timeout issues at scale as well. We were able to
workaround them by setting the following JVM options:


NOTE: these JVM options *must* be set on worker nodes (and not just the
driver/master) for the settings to take.


View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message