spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "" <>
Subject Saprk 1.6 Driver Memory Issue
Date Wed, 01 Jun 2016 15:41:35 GMT
Hi All , 

I am getting spark driver memory issue even after overriding the conf by
using --conf spark.driver.maxResultSize=20g and I also mentioned in my sql
script (set spark.driver.maxResultSize =16;) but still the same error

Job aborted due to stage failure: Total size of serialized results of 79
tasks (1035.2 MB) is bigger than spark.driver.maxResultSize (1024.0 MB)

Any thoughts ?


View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message