hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jing Zhao (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-10323) Allow users to do a dryrun of distcp
Date Tue, 04 Feb 2014 02:54:09 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-10323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jing Zhao updated HADOOP-10323:

    Attachment: HADOOP-10323.000.patch

Preliminary patch to demonstrate the idea. The patch just simply starts the same MR jobs but
does not do any real data copying/modification.

We can provide more information after the dryrun. Also, we may also want to check the checksum
type of the source files during the dryrun.

> Allow users to do a dryrun of distcp
> ------------------------------------
>                 Key: HADOOP-10323
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10323
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: tools/distcp
>            Reporter: Jing Zhao
>            Assignee: Jing Zhao
>         Attachments: HADOOP-10323.000.patch
> This jira plans to add a dryrun option in distcp which will make distcp go through all
the steps except the real data copying. In this way, users can quickly understand potential

This message was sent by Atlassian JIRA

View raw message