spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kexin Xie <kexin....@bigcommerce.com>
Subject Re: How can I make Spark 1.0 saveAsTextFile to overwrite existing file
Date Tue, 03 Jun 2014 03:33:25 GMT
+1 on Option (B) with flag to allow semantics in (A) for back compatibility.

Kexin


On Tue, Jun 3, 2014 at 1:18 PM, Nicholas Chammas <nicholas.chammas@gmail.com
> wrote:

> On Mon, Jun 2, 2014 at 10:39 PM, Patrick Wendell <pwendell@gmail.com>
> wrote:
>
>> (B) Semantics in Spark 1.0 and earlier:
>
>
> Do you mean 1.0 and later?
>
> Option (B) with the exception-on-clobber sounds fine to me, btw. My use
> pattern is probably common but not universal, and deleting user files is
> indeed scary.
>
> Nick
>

Mime
View raw message