spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From qingyang li <liqingyang1...@gmail.com>
Subject Re: Spark 0.9.1 core dumps on Mesos 0.18.0
Date Tue, 17 Jun 2014 07:54:51 GMT
i am using spark 0.9.1 , mesos 0.19.0  and tachyon 0.4.1 ,  is spark0.9.1
compatiable with mesos0.19.0?


2014-06-17 15:50 GMT+08:00 qingyang li <liqingyang1985@gmail.com>:

> hi, steven,  have you resolved this problem?   i encounter the same
> problem, too.
>
>
> 2014-04-18 3:48 GMT+08:00 Sean Owen <sowen@cloudera.com>:
>
> Oh dear I read this as a build problem. I can build with the latest
>> Java 7, including those versions of Spark and Mesos, no problem. I did
>> not deploy them.
>>
>> Mesos does have some native libraries, so it might well be some kind
>> of compatibility issue at that level. Anything more in the error log
>> that would demonstrate it came from Mesos vs the JDK?
>>
>> (I likely don't have anything useful to add here though)
>>
>> On Thu, Apr 17, 2014 at 8:21 PM, andy petrella <andy.petrella@gmail.com>
>> wrote:
>> > No of course, but I was guessing some native libs imported (to
>> communicate
>> > with Mesos) in the project that... could miserably crash the JVM.
>> >
>> > Anyway, so you tell us that using this oracle version, you don't have
>> any
>> > issues when using spark on mesos 0.18.0, that's interesting 'cause
>> AFAIR, my
>> > last test (done by night, which means floating and eventual memory) I
>> was
>> > using this particular version as well.
>> >
>> > Just to make thing clear, Sean, you're using spark 0.9.1 on Mesos 0.18.0
>> > with Hadoop 2.x (x >= 2) without any modification than just specifying
>> > against which version of hadoop you had run make-distribution?
>>
>
>

Mime
View raw message