hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9740) FsShell's Text command does not read avro data files stored on HDFS
Date Tue, 13 Aug 2013 23:18:48 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13738998#comment-13738998

Hudson commented on HADOOP-9740:

SUCCESS: Integrated in Hadoop-trunk-Commit #4253 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/4253/])
HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS.  Contributed
by Allan Yan. (cutting: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1513684)
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/Display.java
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell
* /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/fs/shell/TestTextCommand.java

> FsShell's Text command does not read avro data files stored on HDFS
> -------------------------------------------------------------------
>                 Key: HADOOP-9740
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9740
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.0.5-alpha
>            Reporter: Allan Yan
>            Assignee: Allan Yan
>              Labels: patch
>         Attachments: HADOOP-9740.patch, HADOOP-9740.patch, maven_unit_test_error.log
> HADOOP-8597 added support for reading avro data files from FsShell Text command. However,
it does not work with files stored on HDFS. Here is the error message:
> {code}
> $hadoop fs -text hdfs://localhost:8020/test.avro
> -text: URI scheme is not "file"
> Usage: hadoop fs [generic options] -text [-ignoreCrc] <src> ...
> {code}
> The problem is because the File constructor complains not able to recognize hdfs:// scheme
in during AvroFileInputStream initialization. 
> There is a unit TestTextCommand.java under hadoop-common project. However it only tested
files in local file system. I created a similar one under hadoop-hdfs project using MiniDFSCluster.
Please see attached maven unit test error message with full stack trace for more details.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message