tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maria <linanmengxia...@126.com>
Subject Throwing ExitCodeException when launching MR job(pi)
Date Mon, 18 Apr 2016 07:38:21 GMT

Hi all:
  I configured a new  hadoop2.6.0 environment with tez0.7.0. I test if I installed tez correctly(all
tez parameters use default value):
(1) hadoop jar $TEZ_HOME/tez-examples-0.7.0.jar orderedwordcount input outputdir ——it
ran well.
(2)hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar pi 2 6——failed:
mapreduce.Job: The url to track the job : http://orchid:8034/proxy/application_1460950248211_0004/
mapreduce.Job: Running job: job_1460950248211_0004
mapreduce.Job: Job job_1460950248211_0004 running in uber mode: false
mapreduce.Job: map 0% reduce 0%
Vertex failed,vertexName=initailmap,vertexId=vertex_1460950248211_0004_1_00,diagnostics=[Task
failed,taskId=_1460950248211_0004_1_00_000000,diagnostics=[TaskAttempt 0 failed, info=[Container
container_1460950248211_0004_01_000002 finished with diagnostics set to [Container failed.
Exception from container-launch.
Container id: container_1460950248211_0004_01_000002
Exit code: 1
Stack trace: ExitCodeException exitCode=1;
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:722)
Container exited with a non-zero exit code 1]],……
……
……
Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks: 5, Vertex vertex_1460950248211_0004_1_00
[initialmap] killed/failed due to:null]]]
Vertex killed, vertexName=finalreduce, vertexId=vertex_1460950248211_0004_1_01,diagnostics=[Vertex
received Kill while in RUNNING state., Vertex did not succeed due to OTHER_VERTEX_FAILURE,failedTasks:0
killedTasks:1,Vertex vertex_1460950248211_0004_1_01 [finalreduce] killed/failed due to:null].
DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:1.
16/04/18 14:30:01 INFO mapreduce.Job: Counters: 0
Job Finished in 16.719 seconds
java.io.FileNotFoundException: File does not exist: hdfs://orchid/user/root/QuasiMonteCarlo_1460953729140_505831718/out/reduce-out
    at org.apache.hadoop.hdfs.DistributedFileSystem$18.doCall(DistributedFileSystem.java:1122)
    ……

Hadoop exit 1 means "Operation not permitted"....
I don't know which point is permitted. And there was no log message in YARN 8088. I don't
know what to do about it. 
Does this means some of my tez configurations are not reasonable?

Thanks in advance.

Maria~
Mime
View raw message