spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mike <sp...@good-with-numbers.com>
Subject Re: Strange StackOverflowError with large amount of data in RDD
Date Sat, 07 Sep 2013 02:19:49 GMT
> Any idea why this would occur with a Join query?

I'd guess not that you have a large amount of data causing it, but a 
deep object graph that you're deserializing.  Have you tried Kryo?  Have 
you tried the -Xss Java option?

Mime
View raw message