spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dean Wampler <deanwamp...@gmail.com>
Subject Re: Spark and Java 8
Date Wed, 07 May 2014 00:03:10 GMT
Cloudera customers will need to put pressure on them to support Java 8.
They only officially supported Java 7 when Oracle stopped supporting Java 6.

dean


On Wed, May 7, 2014 at 5:05 AM, Matei Zaharia <matei.zaharia@gmail.com>wrote:

> Java 8 support is a feature in Spark, but vendors need to decide for
> themselves when they’d like support Java 8 commercially. You can still run
> Spark on Java 7 or 6 without taking advantage of the new features (indeed
> our builds are always against Java 6).
>
> Matei
>
> On May 6, 2014, at 8:59 AM, Ian O'Connell <ian@ianoconnell.com> wrote:
>
> I think the distinction there might be they never said they ran that code
> under CDH5, just that spark supports it and spark runs under CDH5. Not that
> you can use these features while running under CDH5.
>
> They could use mesos or the standalone scheduler to run them
>
>
> On Tue, May 6, 2014 at 6:16 AM, Kristoffer Sjögren <stoffe@gmail.com>wrote:
>
>> Hi
>>
>> I just read an article [1] about Spark, CDH5 and Java 8 but did not get
>> exactly how Spark can run Java 8 on a YARN cluster at runtime. Is Spark
>> using a separate JVM that run on data nodes or is it reusing the YARN JVM
>> runtime somehow, like hadoop1?
>>
>> CDH5 only supports Java 7 [2] as far as I know?
>>
>> Cheers,
>> -Kristoffer
>>
>>
>> [1]
>> http://blog.cloudera.com/blog/2014/04/making-apache-spark-easier-to-use-in-java-with-java-8/
>> [2]
>> http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Requirements-and-Supported-Versions/CDH5-Requirements-and-Supported-Versions.html
>>
>>
>>
>>
>>
>
>


-- 
Dean Wampler, Ph.D.
Typesafe
@deanwampler
http://typesafe.com
http://polyglotprogramming.com

Mime
View raw message