We are seeing this issue as well.
We run on YARN and see logs about lost executor. Looks like some stages had
to be re-run to compute RDD partitions lost in the executor.
We were able to complete 20 iterations with 20% full matrix but not beyond
that (total > 100GB).
On Tue, Jun 10, 2014 at 8:32 PM, coderxiang <shuoxiangpub@gmail.com> wrote:
> The executors shown "CANNOT FIND ADDRESS" are not listed in the Executors
> Tab
> on the top of the Spark UI.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Information-on-Spark-UI-tp7354p7355.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
|