hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-3908) jobhistory server trying to load job conf file from wrong location
Date Thu, 23 Feb 2012 22:23:48 GMT
jobhistory server trying to load job conf file from wrong location

                 Key: MAPREDUCE-3908
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3908
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv1
    Affects Versions: 0.23.0
            Reporter: Thomas Graves

I have seen a few instance where I try to click on the job configuration link from the job
history server web ui and it gives a 500 message.  Looking at the job history server log file
it shows an exception like:

2012-02-23 22:16:32,519 ERROR org.apache.hadoop.yarn.webapp.View: Error while reading hdfs://host.com:9000/home/hadoop/mapred/history/done_intermediate/user/job_1330033607650_0001_conf.xml
java.io.FileNotFoundException: File does not exist: /home/hadoop/mapred/history/done_intermediate/user/job_1330033607650_0001_conf.xml
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:746)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:709)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:681)
        at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:302)
        at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:2

If I go look in hdfs, it doesn't exist in the done_intermediate directory anymore, it exists
in the done directory structure.  hdfs://host.com:9000/home/hadoop/mapred/history/done/2012/02/23/000000/job_1330033607650_0001_conf.xml

I'm not exactly sure how to reproduce this, but I definitely see it every once in a while.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message