spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anil Langote <>
Subject Issue with caching
Date Fri, 27 Jan 2017 16:02:51 GMT
Hi All 

I am trying to cache large dataset with storage level memory and sterilization with kyro enabled
when I run my spark job multiple times I get different performance at a times caching dataset
spark hangs and takes forever what is wrong.

The best time I got is 20 mins and some times with same configuration it takes 40 mins why
this is happening ?

Best Regards,
Anil Langote
View raw message