hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Siqi Li (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-6047) Introduce localization phase for mapreduce jobs
Date Wed, 01 Oct 2014 23:19:34 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Siqi Li resolved MAPREDUCE-6047.
    Resolution: Duplicate

> Introduce localization phase for mapreduce jobs
> -----------------------------------------------
>                 Key: MAPREDUCE-6047
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6047
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Siqi Li
>            Assignee: Siqi Li
> we have been experienced lots of task timeout due to localization of a large number of
files. It would be great if we have an additional phase that keep track of how many files
have been localized. Thus for Mappers we had "localization", "map", "sort". For backwards
compatibility, we can keep it 0% but still heartbeat to AM with the status string "5/300 files

This message was sent by Atlassian JIRA

View raw message