hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-11812) Implement listLocatedStatus for ViewFileSystem to speed up split calculation
Date Thu, 10 Sep 2015 19:43:46 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-11812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vinod Kumar Vavilapalli updated HADOOP-11812:
---------------------------------------------
    Fix Version/s: 2.7.2

Just pulled this into branch-2.7 (release 2.7.2) as it already exists in 2.6.1.

branch-2 patch applies cleanly. Ran compilation and TestChRootedFileSystem, TestViewFileSystemLocalFileSystem,
TestViewFileSystemAtHdfsRoot, TestViewFileSystemHdfs before the push.

> Implement listLocatedStatus for ViewFileSystem to speed up split calculation
> ----------------------------------------------------------------------------
>
>                 Key: HADOOP-11812
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11812
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: fs
>    Affects Versions: 2.7.0
>            Reporter: Gera Shegalov
>            Assignee: Gera Shegalov
>            Priority: Blocker
>              Labels: 2.6.1-candidate, 2.7.2-candidate, performance
>             Fix For: 2.6.1, 2.8.0, 2.7.2
>
>         Attachments: HADOOP-11812.001.patch, HADOOP-11812.002.patch, HADOOP-11812.003.patch,
HADOOP-11812.004.patch, HADOOP-11812.005.patch
>
>
> ViewFileSystem is currently not taking advantage of MAPREDUCE-1981. This causes several
x of RPC overhead and added latency.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message