hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Manoj Govindassamy (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-13055) Implement linkMergeSlash for ViewFs
Date Thu, 13 Oct 2016 21:34:20 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Manoj Govindassamy updated HADOOP-13055:
    Attachment: HADOOP-13055.03.patch

Attached v03 patch, an enhancement on top of [~zhz]'s path. It addresses the following

1. More verification for valid linkMergeSlash mount table entries
2. Mountable list update even for linkMergeSlash entry so that callers of FileSystem.getChildFileSystems()
gets to see the slash mountpoint
3. Unit test which makes use of Federated topology and multiple mount tables. and some basic
verification. Will add more tests around renames, distcp in the follow up jiras.
4. Little bit of code cleanups in {{InodeTree}} around the areas where new fixes are added.
More extensive code cleanup in {{ViewFileSystem}} and {{InodeTree}} will be done as part of
a separate jira.

[~andrew.wang], [~eddyxu], [~zhz], can you please take a look at the patch and let me know
your comments ?

> Implement linkMergeSlash for ViewFs
> -----------------------------------
>                 Key: HADOOP-13055
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13055
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs, viewfs
>            Reporter: Zhe Zhang
>            Assignee: Manoj Govindassamy
>         Attachments: HADOOP-13055.00.patch, HADOOP-13055.01.patch, HADOOP-13055.02.patch,
> In a multi-cluster environment it is sometimes useful to operate on the root / slash
directory of an HDFS cluster. E.g., list all top level directories. Quoting the comment in
> {code}
>  *   A special case of the merge mount is where mount table's root is merged
>  *   with the root (slash) of another file system:
>  *   <ul>
>  *   <li>    fs.viewfs.mounttable.default.linkMergeSlash=hdfs://nn99/
>  *   </ul>
>  *   In this cases the root of the mount table is merged with the root of
>  *            <b>hdfs://nn99/ </b> 
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message