hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron T. Myers (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7418) support for multiple slashes in the path separator
Date Tue, 05 Jul 2011 07:05:22 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13059701#comment-13059701
] 

Aaron T. Myers commented on HADOOP-7418:
----------------------------------------

bq. Have you heard of any such issues on OS X?

There are a few known issues with native code compilation on OS X, but it's unlikely this
would be the issue since you probably weren't compiling the native code when running the tests.

I've personally run the tests you identified as failing on my machine with this patch and
they pass just fine.

Two small comments on the latest patch:

# Rather than a {{while}} loop to replace "//", how about just a regex? I think '{{path.replaceAll("/+",
"/")}}' should do the trick.
# Seems like we should also be adding similar code to deal with consecutive back slashes (as
in Windows paths.)

+1 once these are addressed. I'll commit it then if there are no other comments.

> support for multiple slashes in the path separator
> --------------------------------------------------
>
>                 Key: HADOOP-7418
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7418
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 0.23.0
>         Environment: Linux running JDK 1.6
>            Reporter: Sudharsan Sampath
>            Assignee: Andrew Look
>            Priority: Minor
>              Labels: newbie
>             Fix For: 0.23.0
>
>         Attachments: HADOOP-7418.txt, HDFS-1460.txt, HDFS-1460.txt
>
>
> the parsing of the input path string to identify the uri authority conflicts with the
file system paths. For instance the following is a valid path in both the linux file system
and the hdfs.
> //user/directory1//directory2.
> While this works perfectly fine in the command line for manipulating hdfs, the same fails
when specified as the input path for a mapper class with the following expcetion.
> Exception in thread "main" java.net.UnknownHostException: unknown host: user
>         at org.apache.hadoop.ipc.Client$Connection.<init>(Client.java:195)
> as the org.apache.hadoop.fs.Path class assumes the string that follows the '//' to be
an uri authority

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message