hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Uma Maheswara Rao G (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7178) FileSystem should have an option to control the .crc file creations at Local.
Date Fri, 29 Jul 2011 06:04:10 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13072693#comment-13072693

Uma Maheswara Rao G commented on HADOOP-7178:

Hi Nicholas, 

Thanks alot for taking a look on this issue.
If you suggest to add API, i am open for that! :-)

reason Why i added ignoreCrc api is, commandline already has the option to specify ignoreCrc.
Just to make it sync i proposed ignoreCrc in FileSystem also.

your idea also good. I will update the patch.


> FileSystem should have an option to control the .crc file creations at Local.
> -----------------------------------------------------------------------------
>                 Key: HADOOP-7178
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7178
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Uma Maheswara Rao G
>            Assignee: Uma Maheswara Rao G
>         Attachments: HADOOP-7178.1.patch, HADOOP-7178.patch, HADOOP-7178_COMMON.patch,
> When we copy the files from DFS to local, it is creating the .crc files in local filesystem
for the verification of checksum. When user dont want to do any check sum verifications, this
files will not be useful. 
> Command line already has an option ignoreCrc, to control this.
> So, we should have the similar option on FileSystem also..... like fs.ignoreCrc().
>  This should set the setVerifyChecksum to false and also should select the non CheckSumFileSystem
as local fs.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message