hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (MAPREDUCE-4942) mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1
Date Mon, 13 May 2013 07:43:19 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun C Murthy reopened MAPREDUCE-4942:
--------------------------------------


Sigh, I missed this.

There are multiple issues with this patch:
# It's incompatible with hadoop-0.23.x
# Has anyone checked Pig and other projects which have already done necessary to work with
hadoop-0.23?
# This badly hoses all users at Yahoo who were brave enough to move to hadoop-0.23 to test
YARN.

The above reasons, plus given the fact that compatibility b/w hadoop-1 for o.a.h.mapreduce
is a non-starter I propose we revert this.

Thoughts?

----

In future, I'd appreciate a ping if/when major changes to user-facing MR apis occur - I can
provide a lot of context. Thanks.
                
> mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible
with MR1
> -------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4942
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4942
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 2.0.2-alpha
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>             Fix For: 2.0.5-beta
>
>         Attachments: MAPREDUCE-4942.patch
>
>
> The following methods in MR2's {{org.apache.hadoop.mapreduce.Job}} throw an {{InterruptedException}}
but don't in MR1, which makes them incompatible.  (Their Javadoc comments are also missing
that they throw an {{InterruptedException}} anyway)
> I propose that we wrap the {{InterruptedException}} in a {{RuntimeException}}.  
> {code}
> public float setupProgress() throws IOException, InterruptedException
> public float mapProgress() throws IOException, InterruptedException
> public float reduceProgress() throws IOException, InterruptedException
> public boolean isComplete() throws IOException, InterruptedException
> public boolean isSuccessful() throws IOException, InterruptedException
> public void killJob() throws IOException, InterruptedException
> public void killTask(org.apache.hadoop.mapreduce.TaskAttemptID) throws IOException, InterruptedException
> public void failTask(org.apache.hadoop.mapreduce.TaskAttemptID) throws IOException, InterruptedException
> public Counters getCounters() throws IOException, InterruptedException
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message