spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koert Kuipers <ko...@tresata.com>
Subject Re: writing my own RDD
Date Sun, 11 May 2014 18:51:24 GMT
resending... my email somehow never made it to the user list.


On Fri, May 9, 2014 at 2:11 PM, Koert Kuipers <koert@tresata.com> wrote:

> in writing my own RDD i ran into a few issues with respect to stuff being
> private in spark.
>
> in compute i would like to return an iterator that respects task killing
> (as HadoopRDD does), but the mechanics for that are inside the private
> InterruptibleIterator. also the exception i am supposed to throw
> (TaskKilledException) is private to spark.
>

Mime
View raw message