spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Jaggi <mohitja...@gmail.com>
Subject Re: spark with cdh 5.2.1
Date Fri, 30 Jan 2015 05:30:10 GMT
Thanks Nobuhiro. I have my own fork so I can’t use precompiled repos. I copy pasted the hadoop
2.4 profile in pom.xml and replaced 2.4 with 2.5. It seems to have worked, though I wouldn’t
be sure until I run more tests.

> On Jan 29, 2015, at 5:41 PM, Nobuhiro Sue <nsue@e-mail.ne.jp> wrote:
> 
> Mohit,
> 
> I'm using spark modules provided by Cloudera repos, it works fine.
> 
> Please add Cloudera maven repo, and specify dependencies with CDH
> version, like "spark-core_2.10-1.1.0-cdh5.2.1".
> 
> To add Cloudera maven repo, see:
> http://www.cloudera.com/content/cloudera/en/documentation/core/v5-2-x/topics/cdh_vd_cdh5_maven_repo.html
> 
> Nobuhiro Sue(PetaData inc.)
> 
> 2015-01-30 8:33 GMT+09:00 Mohit Jaggi <mohitjaggi@gmail.com>:
>> Hi All,
>> I noticed in pom.xml that there is no entry for Hadoop 2.5. Has anyone tried Spark
with 2.5.0-cdh5.2.1? Will replicating the 2.4 entry be sufficient to make this work?
>> 
>> Mohit.
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message