hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Victor Kim (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5909) JobStatus contains 0.0 values of mapProgress, reduceProgress, setupProgress, cleanupProgress
Date Thu, 29 May 2014 19:45:02 GMT
Victor Kim created MAPREDUCE-5909:
-------------------------------------

             Summary: JobStatus contains 0.0 values of mapProgress, reduceProgress, setupProgress,
cleanupProgress
                 Key: MAPREDUCE-5909
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5909
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 2.4.0
            Reporter: Victor Kim


When I invoke getAllJobs on a JobClient object, I'm receiving an array of JobStatuses. JobStatus
object arrives with fields mapProgress, reduceProgress, setupProgress, cleanupProgress with
0.0 values. So, I'm not able to track the map and reduce job progress through the client.

Seems that because YARN supports variety of applications (not only MR), ApplicationReport
object doesn't contain mapProgress and ReduceProgress. Instead it contains just progress.
Apparently this led to following code during converting from ApplicationReport to JobStatus
object to do following:

{code:title=TypeConverter.java|borderStyle=solid}
public static JobStatus fromYarn(ApplicationReport application, String jobFile) {
//... Some code here
JobStatus jobStatus =
      new JobStatus(
          TypeConverter.fromYarn(application.getApplicationId()),
          0.0f, 0.0f, 0.0f, 0.0f,
          TypeConverter.fromYarn(application.getYarnApplicationState(), application.getFinalApplicationStatus()),
          org.apache.hadoop.mapreduce.JobPriority.NORMAL,
          application.getUser(), application.getName(),
          application.getQueue(), jobFile, trackingUrl, false
      );

//... Some code here
}
{code}




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message