spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koert Kuipers <ko...@tresata.com>
Subject Re: writing my own RDD
Date Sun, 11 May 2014 23:52:46 GMT
will do
On May 11, 2014 6:44 PM, "Aaron Davidson" <ilikerps@gmail.com> wrote:

> You got a good point there, those APIs should probably be marked as
> @DeveloperAPI. Would you mind filing a JIRA for that (
> https://issues.apache.org/jira/browse/SPARK)?
>
>
> On Sun, May 11, 2014 at 11:51 AM, Koert Kuipers <koert@tresata.com> wrote:
>
>> resending... my email somehow never made it to the user list.
>>
>>
>> On Fri, May 9, 2014 at 2:11 PM, Koert Kuipers <koert@tresata.com> wrote:
>>
>>> in writing my own RDD i ran into a few issues with respect to stuff
>>> being private in spark.
>>>
>>> in compute i would like to return an iterator that respects task killing
>>> (as HadoopRDD does), but the mechanics for that are inside the private
>>> InterruptibleIterator. also the exception i am supposed to throw
>>> (TaskKilledException) is private to spark.
>>>
>>
>>
>

Mime
View raw message