spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Avishek Saha <avishek.s...@gmail.com>
Subject PySpark + executor lost
Date Thu, 07 Aug 2014 02:25:37 GMT
Hi,

I get a lot of executor lost error for "saveAsTextFile" with PySpark
and Hadoop 2.4.

For small datasets this error occurs but since the dataset is small it
gets eventually written to the file.
For large datasets, it takes forever to write the final output.

Any help is appreciated.
Avishek

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message