spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Wendell <pwend...@gmail.com>
Subject Re: ExternalAppendOnlyMap throw no such element
Date Wed, 22 Jan 2014 05:36:42 GMT
This code has been modified since you reported this so you may want to
try the current master.

- Patrick

On Mon, Jan 20, 2014 at 4:22 AM, guojc <guojc03@gmail.com> wrote:
> Hi,
>   I'm tring out lastest master branch of spark for the exciting external
> hashmap feature. I have a code that is running correctly at spark 0.8.1 and
> I only make a change for its easily to be spilled to disk. However, I
> encounter a few task failure of
> java.util.NoSuchElementException (java.util.NoSuchElementException)
> org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator.next(ExternalAppendOnlyMap.scala:277)org.apache.spark.util.collection.ExternalAppendOnlyMap$ExternalIterator.next(ExternalAppendOnlyMap.scala:212)org.apache.spark.InterruptibleIterator.next(InterruptibleIterator.scala:29)
> And the job seems to fail to recover.
> Can anyone give some suggestion on how to investigate the issue?
> Thanks,Jiacheng Guo

Mime
View raw message