hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-12979) IOE in S3a: ${hadoop.tmp.dir}/s3a not configured
Date Wed, 30 Mar 2016 14:40:25 GMT
Steve Loughran created HADOOP-12979:

             Summary: IOE in S3a:  ${hadoop.tmp.dir}/s3a not configured
                 Key: HADOOP-12979
                 URL: https://issues.apache.org/jira/browse/HADOOP-12979
             Project: Hadoop Common
          Issue Type: Bug
    Affects Versions: 2.8.0
            Reporter: Steve Loughran

Running some spark s3a tests trigger an NPE in Hadoop <=2/7l IOE in 2.8 saying "${hadoop.tmp.dir}/s3a
not configured".

That's correct: there is no configuration option on the conf called "${hadoop.tmp.dir}/s3a
". There may be one called {{hadoop.tmp.dir}}, however.

Essentially s3a is sending the wrong config option down, if it can't find {{fs.s3a.buffer.dir}}

This message was sent by Atlassian JIRA

View raw message