spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koert Kuipers <ko...@tresata.com>
Subject Re: spark disk-to-disk
Date Mon, 23 Mar 2015 17:39:37 GMT
i just realized the major limitation is that i lose partitioning info...

On Mon, Mar 23, 2015 at 1:34 AM, Reynold Xin <rxin@databricks.com> wrote:

>
> On Sun, Mar 22, 2015 at 6:03 PM, Koert Kuipers <koert@tresata.com> wrote:
>
>> so finally i can resort to:
>> rdd.saveAsObjectFile(...)
>> sc.objectFile(...)
>> but that seems like a rather broken abstraction.
>>
>>
> This seems like a fine solution to me.
>
>

Mime
View raw message