hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HADOOP-13974) S3a CLI to support list/purge of pending multipart commits
Date Wed, 11 Jan 2017 14:46:58 GMT
Steve Loughran created HADOOP-13974:

             Summary: S3a CLI to support list/purge of pending multipart commits
                 Key: HADOOP-13974
                 URL: https://issues.apache.org/jira/browse/HADOOP-13974
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
    Affects Versions: HADOOP-13345
            Reporter: Steve Loughran

The S3A CLI will need to be able to list and delete pending multipart commits. 

We can do the cleanup already via fs.s3a properties. The CLI will let scripts stat for outstanding
data (have a different exit code) and permit batch jobs to explicitly trigger cleanups.

This will become critical with the multipart committer, as there's a significantly higher
likelihood of commits remaining outstanding.

We may also want to be able to enumerate/cancel all pending commits in the FS tree

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message