tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dharmesh Kakadia (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3453) Hive + Tez not able to push-down common sub expression
Date Thu, 29 Sep 2016 21:31:20 GMT
Dharmesh Kakadia created TEZ-3453:
-------------------------------------

             Summary: Hive + Tez not able to push-down common sub expression 
                 Key: TEZ-3453
                 URL: https://issues.apache.org/jira/browse/TEZ-3453
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Dharmesh Kakadia
            Priority: Minor


hadoop jar /usr/hdp/current/tez-client/tez-job-analyzer-*.jar CriticalPath --dagId=dag_1475171170456_0002_1
--outputDir=tmp/
fails with

INFO history.ATSImportTool: Using baseURL=http://headnodehost:8188/ws/v1/timeline, dagId=dag_1475171170456_0002_1,
batchSize=100, downloadDir=tmp
java.lang.IllegalArgumentException: Zipfile tmp/dag_1475171170456_0002_1/dag_1475171170456_0002_1.zip
does not exist
at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
at org.apache.tez.history.parser.ATSFileParser.(ATSFileParser.java:65)
at org.apache.tez.analyzer.plugins.TezAnalyzerBase.run(TezAnalyzerBase.java:169)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.tez.analyzer.plugins.CriticalPathAnalyzer.main(CriticalPathAnalyzer.java:653)

The code is incorrectly expecting it to be in subfolder(dag_1475171170456_0002_1/dag_1475171170456_0002_1.zip).
Moving the downloaded data location to the subfolder fixes the issue. This PR corrects the
expected path.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message