spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Davies Liu <dav...@databricks.com>
Subject Re: PySpark + executor lost
Date Thu, 07 Aug 2014 22:04:08 GMT
What is the environment ? YARN or Mesos or Standalone?

It will be more helpful if you could show more loggings.

On Wed, Aug 6, 2014 at 7:25 PM, Avishek Saha <avishek.saha@gmail.com> wrote:
> Hi,
>
> I get a lot of executor lost error for "saveAsTextFile" with PySpark
> and Hadoop 2.4.
>
> For small datasets this error occurs but since the dataset is small it
> gets eventually written to the file.
> For large datasets, it takes forever to write the final output.
>
> Any help is appreciated.
> Avishek
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message