hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nishan Shetty, Huawei (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5961) Job start time setting to "Thu Jan 01 05:29:59 IST 1970"
Date Mon, 07 Jul 2014 09:55:34 GMT
Nishan Shetty, Huawei created MAPREDUCE-5961:
------------------------------------------------

             Summary: Job start time setting to "Thu Jan 01 05:29:59 IST 1970"
                 Key: MAPREDUCE-5961
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5961
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobhistoryserver
            Reporter: Nishan Shetty, Huawei
            Priority: Minor


2.Induce RM switchover while job is in progress

Observe that  job start time setting to "Thu Jan 01 05:29:59 IST 1970" saying below error

{code}

2014-07-05 21:38:12,415 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Moving
hdfs://mycluster:8020/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0056_conf.xml
to hdfs://mycluster:8020/home/testos/staging-dir/history/done/2014/07/05/000000/job_1404572770516_0056_conf.xml
2014-07-05 21:41:12,289 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistory: Starting scan to
move intermediate done files
2014-07-05 21:41:12,294 WARN org.apache.hadoop.mapreduce.v2.jobhistory.FileNameIndexUtils:
Unable to parse launch time from job history file job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist
: java.lang.NumberFormatException: For input string: ""
2014-07-05 21:41:12,297 INFO org.apache.hadoop.mapreduce.jobhistory.JobSummary: jobId=job_1404572770516_0057,submitTime=1404576372149,launchTime=-1,firstMapTaskLaunchTime=1404576442635,firstReduceTaskLaunchTime=1404576492243,finishTime=1404576499406,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=85,numReduces=10,user=testos,queue=default,status=SUCCEEDED,mapSlotSeconds=690,reduceSlotSeconds=39,jobName=word
count
2014-07-05 21:41:12,298 INFO org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager: Deleting
JobSummary file:
{code}

AM LOG

{code}

2014-07-05 21:38:19,432 INFO [Thread-74] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
JobHistoryEventHandler notified that forceJobCompletion is true
2014-07-05 21:38:19,432 INFO [Thread-74] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Calling
stop for all the services
2014-07-05 21:38:19,433 INFO [Thread-74] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Stopping JobHistoryEventHandler. Size of the outstanding queue size is 0
2014-07-05 21:38:19,556 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copying hdfs://mycluster/home/testos/staging-dir/testos/.staging/job_1404572770516_0057/job_1404572770516_0057_2.jhist
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist_tmp
2014-07-05 21:38:19,770 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copied to done location: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist_tmp
2014-07-05 21:38:19,785 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copying hdfs://mycluster/home/testos/staging-dir/testos/.staging/job_1404572770516_0057/job_1404572770516_0057_2_conf.xml
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml_tmp
2014-07-05 21:38:19,862 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Copied to done location: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml_tmp
2014-07-05 21:38:19,886 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057.summary_tmp
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057.summary
2014-07-05 21:38:19,898 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml_tmp
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057_conf.xml
2014-07-05 21:38:19,910 INFO [eventHandlingThread] org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler:
Moved tmp to done: hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist_tmp
to hdfs://mycluster/home/testos/staging-dir/history/done_intermediate/testos/job_1404572770516_0057-1404576372149-testos-word+count-1404576499406-85-10-SUCCEEDED-default--1.jhist
{code}




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message