spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <ste...@hortonworks.com>
Subject Re: Help accessing protected S3
Date Fri, 24 Jul 2015 00:07:34 GMT

> On 23 Jul 2015, at 10:47, Greg Anderson <gregory.anderson@familysearch.org> wrote:
> 
> So when I go to ~/ephemeral-hdfs/bin/hadoop and check its version, it says Hadoop 2.0.0-cdh4.2.0.
 If I run pyspark and use the s3a address, things should work, right?  What am I missing?
 And thanks so much for the help so far!

nope, sorry. You'll need a CDH 5.x for s3a, and the more recent one, 5.3? to get s3a to work
reliably.


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message