spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Darin McBeath <ddmcbe...@yahoo.com.INVALID>
Subject Question about the spark assembly deployed to the cluster with the ec2 scripts
Date Thu, 05 Mar 2015 22:14:50 GMT
I've downloaded spark  1.2.0 to my laptop.  In the lib directory, it includes spark-assembly-1.2.0-hadoop2.4.0.jar

When I spin up a cluster using the ec2 scripts with 1.2.0 (and set --hadoop-major-version=2)
I notice that in the lib directory for the master/slaves the assembly is for hadoop2.0.0 (and
I think Cloudera).

Is there a way that I  can force the install of the same assembly to the cluster that comes
with the 1.2 download of spark?

Thanks.

Darin.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message