spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ian O'Connell" <...@ianoconnell.com>
Subject Re: Spark and Java 8
Date Tue, 06 May 2014 15:59:12 GMT
I think the distinction there might be they never said they ran that code
under CDH5, just that spark supports it and spark runs under CDH5. Not that
you can use these features while running under CDH5.

They could use mesos or the standalone scheduler to run them


On Tue, May 6, 2014 at 6:16 AM, Kristoffer Sjögren <stoffe@gmail.com> wrote:

> Hi
>
> I just read an article [1] about Spark, CDH5 and Java 8 but did not get
> exactly how Spark can run Java 8 on a YARN cluster at runtime. Is Spark
> using a separate JVM that run on data nodes or is it reusing the YARN JVM
> runtime somehow, like hadoop1?
>
> CDH5 only supports Java 7 [2] as far as I know?
>
> Cheers,
> -Kristoffer
>
>
> [1]
> http://blog.cloudera.com/blog/2014/04/making-apache-spark-easier-to-use-in-java-with-java-8/
> [2]
> http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Requirements-and-Supported-Versions/CDH5-Requirements-and-Supported-Versions.html
>
>
>
>
>

Mime
View raw message