sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shuaishuai Nie (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1033) CombineFileInputFormat does not work with paths not on default FS like ASV
Date Wed, 08 May 2013 00:47:15 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13651502#comment-13651502
] 

Shuaishuai Nie commented on SQOOP-1033:
---------------------------------------

Thanks Venkat. CombineFileInputFormat strips out the scheme and authority components of the
path, after which point the path is assumed to be on the default file system and cannot locate
the file correctly on non-default file system. Since Sqoop and Hadoop share the same code
for the CombineFileInputFormat and the Hadoop version has already made the related fix, the
same fix should also be apply to the CombineFileInputFormat in Sqoop. The review is available
here https://reviews.apache.org/r/10988/ 
                
> CombineFileInputFormat does not work with paths not on default FS like ASV
> --------------------------------------------------------------------------
>
>                 Key: SQOOP-1033
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1033
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.4
>            Reporter: Shuaishuai Nie
>         Attachments: SQOOP-1033.1.patch
>
>
> CombineFileInputFormat does not work with ASV. This appeared as an issue in Sqoop which
failed to export files in ASV. CombineFileInputFormat strips out the scheme and authority
components of the path, after which point the path is assumed to be on the default file system.
>  Sqoop has it own copy of CombineFileInputFormat, but updated the ones in core as well
for consistency.
> There are currently already solved Jiras for the same issue:
> https://issues.apache.org/jira/browse/MAPREDUCE-2704
> https://issues.apache.org/jira/browse/MAPREDUCE-1806

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message