spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Avishek Saha <>
Subject PySpark + executor lost
Date Thu, 07 Aug 2014 02:25:37 GMT

I get a lot of executor lost error for "saveAsTextFile" with PySpark
and Hadoop 2.4.

For small datasets this error occurs but since the dataset is small it
gets eventually written to the file.
For large datasets, it takes forever to write the final output.

Any help is appreciated.

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message