hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hua xu (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5388) There are two TaskLaunchers for map after the TaskTracker reinit
Date Mon, 15 Jul 2013 06:34:48 GMT
Hua xu created MAPREDUCE-5388:
---------------------------------

             Summary: There are two TaskLaunchers for map after the TaskTracker reinit
                 Key: MAPREDUCE-5388
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5388
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: tasktracker
    Affects Versions: 1.0.3, 0.22.0, 0.21.0
            Reporter: Hua xu


The TaskTracker was asked to reinit as the full gc,then the process contained of two TaskLauncher
instance for map:
{code}


2013-06-22 08:32:59,457 INFO org.apache.hadoop.mapred.TaskTracker: Process Thread Dump: lost
task
36 active threads

......

Thread 43 (TaskLauncher for REDUCE tasks):
  State: WAITING
  Blocked count: 73824
  Waited count: 72848
  Waiting on java.util.LinkedList@98a9557
  Stack:
    java.lang.Object.wait(Native Method)
    java.lang.Object.wait(Object.java:485)
    org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2157)
Thread 42 (TaskLauncher for MAP tasks):
  State: WAITING
  Blocked count: 358814
  Waited count: 356105
  Waiting on org.apache.hadoop.ipc.Client$Call@6f764bc1
  Stack:
    java.lang.Object.wait(Native Method)
    java.lang.Object.wait(Object.java:485)
    org.apache.hadoop.ipc.Client.call(Client.java:891)
    org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:198)
    $Proxy5.getFileInfo(Unknown Source)
    sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
    sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    java.lang.reflect.Method.invoke(Method.java:597)
    org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
    org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
    $Proxy5.getFileInfo(Unknown Source)
    org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:850)
    org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:620)
    org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:215)
    org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:167)
    org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1543)
    org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1524)
    org.apache.hadoop.mapred.TaskTracker.localizeJobTokenFile(TaskTracker.java:3995)
    org.apache.hadoop.mapred.TaskTracker.localizeJobFiles(TaskTracker.java:1036)
    org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:977)

......

Thread 1 (main):
  State: RUNNABLE
  Stack:
    sun.management.ThreadImpl.getThreadInfo1(Native Method)
    sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:156)
    sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:121)
    org.apache.hadoop.util.ReflectionUtils.printThreadInfo(ReflectionUtils.java:157)
    org.apache.hadoop.util.ReflectionUtils.logThreadInfo(ReflectionUtils.java:211)
    org.apache.hadoop.mapred.TaskTracker.markUnresponsiveTasks(TaskTracker.java:1792)
    org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:1468)
    org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:2329)
    org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3461)

{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message