hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9761) ViewFileSystem#rename fails when using DistributedFileSystem
Date Sat, 03 Aug 2013 14:11:50 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728544#comment-13728544

Hudson commented on HADOOP-9761:

SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1507 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1507/])
HADOOP-9761.  ViewFileSystem#rename fails when using DistributedFileSystem (Andrew Wang via
Colin Patrick McCabe) (cmccabe: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1509874)
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystemLinkResolver.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/viewfs/TestViewFileSystemHdfs.java

> ViewFileSystem#rename fails when using DistributedFileSystem
> ------------------------------------------------------------
>                 Key: HADOOP-9761
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9761
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: viewfs
>    Affects Versions: 3.0.0, 2.1.0-beta
>            Reporter: Andrew Wang
>            Assignee: Andrew Wang
>             Fix For: 2.3.0
>         Attachments: 0001-HADOOP-9761.004.patch, hadoop-9761-1.patch, hadoop-9761-1.patch,
> ViewFileSystem currently passes unqualified paths (no scheme or authority) to underlying
FileSystems when doing a rename. DistributedFileSystem symlink support added in HADOOP-9418
needs to qualify and check rename sources and destinations since cross-filesystem renames
aren't supported, so this breaks in the following way
> - Default FS URI is configured to viewfs://<viewfs>
> - When doing a rename, ViewFileSystem checks to make sure both src and dst FileSystems
are the same (which they are, both in same DFS), and then calls DistributedFileSystem#rename
with unqualified "remainder" paths
> - Since these paths are unqualified, DFS qualifies them with the default FS to check
that it can do the rename. This turns it into viewfs://<viewfs>/<path>
> - Since viewfs://<viewfs> is not the DFS's URI, DFS errors out the rename.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message