tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From AzuryYu <azur...@outlook.com>
Subject Re: Cannot submit Tez application
Date Sun, 11 May 2014 15:17:12 GMT
Thanks Hitesh.
I had another reply in this thread, the main reason is I enabled HDFS HA, Tez cannot find
hdfs-site.xml, so there is UnknownHostException in the AM log.

The application works after I uploaded hdfs-site.xml to the Tez-lib-Uris. But it looks strange
Tez cannot find hdfs-site.

Ps. All fine if I disable Tez.


Sent from my iPhone5s

> On 2014年5月11日, at 23:01, "Hitesh Shah" <hitesh@apache.org> wrote:
> 
> BCC’ing dev@tez.
> 
> Re-directing to hive list.
> 
> @Azury Yu, would you mind providing the query details to the hive folks. Seems like an
issue in the DAG plan generation in Hive. 
> 
> thanks
> ― Hitesh
> 
>> On May 10, 2014, at 8:26 PM, AzuryYu <azuryyu@outlook.com> wrote:
>> 
>> Hi,
>> 
>> I built Tez-0.5 against hadoop-2.4.0, and I've put all jars to the HDFS, configured
tez-site.xml correctly.
>> 
>> Hive version is 0.13.0, I've set hive.execution.engine to tez in hive-site.xml
>> 
>> then I submit the hive query, got the following exception:
>> 
>> 2014-05-11 11:13:08,533 ERROR [main]: exec.Task (TezTask.java:execute(185)) - Failed
to execute tez graph.
>> java.lang.IllegalStateException: Vertex: Reducer 4 already has group input with name:Union
3
>>       at org.apache.tez.dag.api.Vertex.addGroupInput(Vertex.java:250)
>>       at org.apache.tez.dag.api.DAG.processEdgesAndGroups(DAG.java:223)
>>       at org.apache.tez.dag.api.DAG.verify(DAG.java:284)
>>       at org.apache.tez.dag.api.DAG.createDag(DAG.java:462)
>>       at org.apache.tez.client.TezSession.submitDAG(TezSession.java:216)
>>       at org.apache.tez.client.TezSession.submitDAG(TezSession.java:155)
>>       at org.apache.hadoop.hive.ql.exec.tez.TezTask.submit(TezTask.java:320)
>>       at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:165)
>>       at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:153)
>>       at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:85)
>>       at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1503)
>>       at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1270)
>>       at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1088)
>>       at org.apache.hadoop.hive.ql.Driver.run(Driver.java:911)
>>       at org.apache.hadoop.hive.ql.Driver.run(Driver.java:901)
>>       at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
>>       at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
>>       at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
>>       at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:359)
>>       at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:742)
>>       at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
>>       at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
>>       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>       at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>       at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>       at java.lang.reflect.Method.invoke(Method.java:606)
>>       at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
>> 2014-05-11 11:13:08,554 ERROR [main]: ql.Driver (SessionState.java:printError(545))
- FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask
> 
Mime
View raw message