spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From JG Perrin <jper...@lumeris.com>
Subject RE: Quick one... AWS SDK version?
Date Tue, 03 Oct 2017 20:34:41 GMT
Thanks Yash… this is helpful!

From: Yash Sharma [mailto:yash360@gmail.com]
Sent: Tuesday, October 03, 2017 1:02 AM
To: JG Perrin <jperrin@lumeris.com>; user@spark.apache.org
Subject: Re: Quick one... AWS SDK version?


Hi JG,
Here are my cluster configs if it helps.

Cheers.

EMR: emr-5.8.0
Hadoop distribution: Amazon 2.7.3
AWS sdk: /usr/share/aws/aws-java-sdk/aws-java-sdk-1.11.160.jar
Applications:
Hive 2.3.0
Spark 2.2.0
Tez 0.8.4

On Tue, 3 Oct 2017 at 12:29 JG Perrin <jperrin@lumeris.com<mailto:jperrin@lumeris.com>>
wrote:
Hey Sparkians,

What version of AWS Java SDK do you use with Spark 2.2? Do you stick with the Hadoop 2.7.3
libs?

Thanks!

jg
Mime
View raw message