hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paul Yang (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-1877) getConetentSummary() for HarFileSystem throws IllegalArgumentException
Date Sat, 19 Jun 2010 00:31:23 GMT
getConetentSummary() for HarFileSystem throws IllegalArgumentException

                 Key: MAPREDUCE-1877
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1877
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: harchive
    Affects Versions: 0.22.0
            Reporter: Paul Yang

As HarFileSystem does not implement getContentSummary(), the implementation from FilterFileSystem
is inherited by default. However, FilterFileSystem.getContentSummary() does not work for the
HarFileSystem because the method attempts to use HarFileSystem's underlying FS to call getContentSummary().
In the case where the the underlying filesystem is HDFS, an exception similar to the following
is thrown:

java.lang.IllegalArgumentException: Wrong FS: har://hdfs-example.com:9000/tmp/data.har, expected:
        at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:352)
        at org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getContentSummary(DistributedFileSystem.java:232)
        at org.apache.hadoop.fs.FilterFileSystem.getContentSummary(FilterFileSystem.java:287)
        at org.apache.hadoop.fs.FilterFileSystem.getContentSummary(FilterFileSystem.java:287)

One solution is to implement HarFileSystem.getContentSummary() using code similar to FileSystem.getContentSummary().

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message