hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allan Yan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-9740) FsShell's Text command does not read avro data files stored on HDFS
Date Wed, 17 Jul 2013 06:14:48 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Allan Yan updated HADOOP-9740:

    Status: Patch Available  (was: Open)
> FsShell's Text command does not read avro data files stored on HDFS
> -------------------------------------------------------------------
>                 Key: HADOOP-9740
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9740
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.0.5-alpha
>            Reporter: Allan Yan
>              Labels: patch
> HADOOP-8597 added support for reading avro data files from FsShell Text command. However,
it does not work with files stored on HDFS. Here is the error message:
> {code}
> $hadoop fs -text hdfs://localhost:8020/test.avro
> -text: URI scheme is not "file"
> Usage: hadoop fs [generic options] -text [-ignoreCrc] <src> ...
> {code}
> The problem is because the File constructor complains not able to recognize hdfs:// scheme
in during AvroFileInputStream initialization. 
> There is a unit TestTextCommand.java under hadoop-common project. However it only tested
files in local file system. I created a similar one under hadoop-hdfs project using MiniDFSCluster.
Please see attached maven unit test error message with full stack trace for more details.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message