hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Oleksandr Alesinskyy (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5859) org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus should not throw an exception if at least one of input path is not empty
Date Fri, 25 Apr 2014 14:48:14 GMT
Oleksandr Alesinskyy created MAPREDUCE-5859:
-----------------------------------------------

             Summary: org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus should
not throw an exception if at least one of input path is not empty
                 Key: MAPREDUCE-5859
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5859
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: client
    Affects Versions: 2.2.0
            Reporter: Oleksandr Alesinskyy


At the time being
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus throws an exception if at
least one of input path is empty. This is pretty inconvenient, especially, it there are additional
path filters that may exclude some files on the path.

It would be nice if an exception will be thrown if and only if there is no one file to process
at all (on all input paths combined).

If backward compatibility is a priority, a configuration setting may be added (with the default
value to retain existing behavior).




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message