spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From qingyang li <liqingyang1...@gmail.com>
Subject Re: Spark 0.9.1 core dumps on Mesos 0.18.0
Date Tue, 17 Jun 2014 07:50:29 GMT
hi, steven,  have you resolved this problem?   i encounter the same
problem, too.


2014-04-18 3:48 GMT+08:00 Sean Owen <sowen@cloudera.com>:

> Oh dear I read this as a build problem. I can build with the latest
> Java 7, including those versions of Spark and Mesos, no problem. I did
> not deploy them.
>
> Mesos does have some native libraries, so it might well be some kind
> of compatibility issue at that level. Anything more in the error log
> that would demonstrate it came from Mesos vs the JDK?
>
> (I likely don't have anything useful to add here though)
>
> On Thu, Apr 17, 2014 at 8:21 PM, andy petrella <andy.petrella@gmail.com>
> wrote:
> > No of course, but I was guessing some native libs imported (to
> communicate
> > with Mesos) in the project that... could miserably crash the JVM.
> >
> > Anyway, so you tell us that using this oracle version, you don't have any
> > issues when using spark on mesos 0.18.0, that's interesting 'cause
> AFAIR, my
> > last test (done by night, which means floating and eventual memory) I was
> > using this particular version as well.
> >
> > Just to make thing clear, Sean, you're using spark 0.9.1 on Mesos 0.18.0
> > with Hadoop 2.x (x >= 2) without any modification than just specifying
> > against which version of hadoop you had run make-distribution?
>

Mime
View raw message