hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9590) Move to JDK7 improved APIs for file operations when available
Date Sat, 14 Dec 2013 17:36:08 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13848414#comment-13848414
] 

Steve Loughran commented on HADOOP-9590:
----------------------------------------

Hadoop does now build & run everywhere, which means that someone needs to start the conversation
in hadoop-common-dev "when will trunk mandate java7?". 

> Move to JDK7 improved APIs for file operations when available
> -------------------------------------------------------------
>
>                 Key: HADOOP-9590
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9590
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Ivan Mitic
>
> JDK6 does not have a complete support for local file system file operations. Specifically:
> - There is no symlink/hardlink APIs what forced Hadoop to defer to shell based tooling
> - No error information returned when File#mkdir/mkdirs or File#renameTo fails, making
it unnecessary hard to troubleshoot some issues
> - File#canRead/canWrite/canExecute do not perform any access checks on Windows making
APIs inconsistent with the Unix behavior
> - File#setReadable/setWritable/setExecutable do not change access rights on Windows making
APIs inconsistent with the Unix behavior
> - File#length does not work as expected on symlinks on Windows
> - File#renameTo does not work as expected on symlinks on Windows
> All above resulted in Hadoop community having to fill in the gaps by providing equivalent
native implementations or applying workarounds. 
> JDK7 addressed (as far as I know) all (or most) of the above problems, either thru the
newly introduced [Files|http://docs.oracle.com/javase/7/docs/api/java/nio/file/Files.html]
class or thru bug fixes.
> This is a tracking Jira to revisit above mediations once JDK7 becomes the supported platform
by the Hadoop community. This work would allow significant portion of the native platform-dependent
code to be replaced with Java equivalents what is goodness w.r.t. Hadoop cross-platform support.




--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message