spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Darin McBeath <>
Subject Question about the spark assembly deployed to the cluster with the ec2 scripts
Date Thu, 05 Mar 2015 22:14:50 GMT
I've downloaded spark  1.2.0 to my laptop.  In the lib directory, it includes spark-assembly-1.2.0-hadoop2.4.0.jar

When I spin up a cluster using the ec2 scripts with 1.2.0 (and set --hadoop-major-version=2)
I notice that in the lib directory for the master/slaves the assembly is for hadoop2.0.0 (and
I think Cloudera).

Is there a way that I  can force the install of the same assembly to the cluster that comes
with the 1.2 download of spark?



To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message