hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mingliang Liu (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-12473) distcp's ignoring failures should be mutually exclusive with the atomic option
Date Mon, 02 Nov 2015 22:46:27 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Mingliang Liu updated HADOOP-12473:
-----------------------------------
    Attachment: HADOOP-12473.001.patch

The v1 patch makes sure the {{ignoreFailures}} is always reset in case of exception.

> distcp's ignoring failures should be mutually exclusive with the atomic option
> ------------------------------------------------------------------------------
>
>                 Key: HADOOP-12473
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12473
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: tools/distcp
>    Affects Versions: 2.7.1
>            Reporter: Mingliang Liu
>            Assignee: Mingliang Liu
>            Priority: Critical
>             Fix For: 2.8.0
>
>         Attachments: HADOOP-12473.000.patch, HADOOP-12473.001.patch
>
>
> In {{CopyMapper::handleFailure}}, the mapper handles failure and will ignore it if no
it's config key is on. Ignoring failures should be mutually exclusive with the atomic option
otherwise an incomplete dir is eligible for commit defeating the purpose.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message