hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Haibo Chen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6851) Terasort does not work with S3 FileSystem
Date Fri, 24 Feb 2017 17:31:44 GMT
Haibo Chen created MAPREDUCE-6851:

             Summary: Terasort does not work with S3 FileSystem
                 Key: MAPREDUCE-6851
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6851
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: examples
    Affects Versions: 3.0.0-alpha2
            Reporter: Haibo Chen

Terasort currently writes a partition list file in the output directory and add it to distributed
cache. If a S3 bucket is used as the output directory, the job may fail because the partition
list file will be localized by NMs which may not have the s3 credentials.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

View raw message