spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Holway <>
Subject python environments with "local" and "yarn-client" - Boto failing on HDP2.5
Date Tue, 29 Nov 2016 15:08:02 GMT

I am making some calls with Boto3 in my pyspark which is working fine in
master=local mode but when I switch to master=yarn I am getting
"NoCredentialsError: Unable to locate credentials" which is a bit annoying
as I cannot work out why!

I have been running this application fine on Mesos and EMR. Does HDP
PySpark2 run within a virtualenv or something?



Otter Networks UG
Gotenstra├če 17
10829 Berlin

View raw message