spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From S├ębastien Rainville <sebastienrainvi...@gmail.com>
Subject Re: Fine-grained mesos execution hangs on Debian 7.4
Date Thu, 26 Jun 2014 19:23:41 GMT
Hello Federico,

is it working with the 1.0 branch? In either branch, make sure that you
have this commit:
https://github.com/apache/spark/commit/1132e472eca1a00c2ce10d2f84e8f0e79a5193d3
I never saw the behavior you are describing, but that commit is important
if you are running in fine-grained mode, and it was merged only yesterday.

- Sebastien



On Thu, Jun 26, 2014 at 12:11 PM, Fedechicco <fedechicco@gmail.com> wrote:

> Hello,
>
> as from object, when I run scala spark-shell on our mesos (0.19) cluster
> some spark slaves just hang at the end of the staging phase for any given
> elaboration.
>
> The cluster has mixed OSes (Ubuntu 14.04 / Debian 7.4), but if I run the
> same shell and commands using coarse grained mode everything works just
> fine.
>
> I'm using a spark 1.1.0-SNAPSHOT built from sources (pulled today from
> git), on openjdk-7.
>
> Sadly I can't get any error message from the sandboxes for the hanging
> slaves, everything seems in order, just stuck.
>
> Any suggestion on how to debug this?
>
> thanks,
> Federico
>

Mime
View raw message