spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Holway <andrew.hol...@otternetworks.de>
Subject python environments with "local" and "yarn-client" - Boto failing on HDP2.5
Date Tue, 29 Nov 2016 15:08:02 GMT
Hey,

I am making some calls with Boto3 in my pyspark which is working fine in
master=local mode but when I switch to master=yarn I am getting
"NoCredentialsError: Unable to locate credentials" which is a bit annoying
as I cannot work out why!

I have been running this application fine on Mesos and EMR. Does HDP
PySpark2 run within a virtualenv or something?

Cheers,

Andrew

-- 
Otter Networks UG
http://otternetworks.de
Gotenstra├če 17
10829 Berlin

Mime
View raw message