spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aaron Davidson <ilike...@gmail.com>
Subject Re: writing my own RDD
Date Sun, 11 May 2014 20:56:34 GMT
You got a good point there, those APIs should probably be marked as
@DeveloperAPI. Would you mind filing a JIRA for that (
https://issues.apache.org/jira/browse/SPARK)?


On Sun, May 11, 2014 at 11:51 AM, Koert Kuipers <koert@tresata.com> wrote:

> resending... my email somehow never made it to the user list.
>
>
> On Fri, May 9, 2014 at 2:11 PM, Koert Kuipers <koert@tresata.com> wrote:
>
>> in writing my own RDD i ran into a few issues with respect to stuff being
>> private in spark.
>>
>> in compute i would like to return an iterator that respects task killing
>> (as HadoopRDD does), but the mechanics for that are inside the private
>> InterruptibleIterator. also the exception i am supposed to throw
>> (TaskKilledException) is private to spark.
>>
>
>

Mime
View raw message