hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuefu Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12365) Added resource path is sent to cluster as an empty string when externally removed
Date Sun, 08 Nov 2015 02:51:10 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995497#comment-14995497
] 

Xuefu Zhang commented on HIVE-12365:
------------------------------------

+1

> Added resource path is sent to cluster as an empty string when externally removed
> ---------------------------------------------------------------------------------
>
>                 Key: HIVE-12365
>                 URL: https://issues.apache.org/jira/browse/HIVE-12365
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 1.2.1
>            Reporter: Chaoyu Tang
>            Assignee: Chaoyu Tang
>         Attachments: HIVE-12365.patch, HIVE-12365.patch
>
>
> Sometimes the resources (e.g. jar) added via command like "add jars <filepath>"
are removed externally from their filepath for some reasons. Their paths are sent to cluster
as empty strings which causes the failures to the query that even do not need these jars in
execution. The error look like as following:
> {code}
> 15/11/06 21:56:44 INFO mapreduce.JobSubmitter: Cleaning up the staging area file:/tmp/hadoop-ctang/mapred/staging/ctang734817191/.staging/job_local734817191_0003
> java.lang.IllegalArgumentException: Can not create a Path from an empty string
> 	at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
> 	at org.apache.hadoop.fs.Path.<init>(Path.java:135)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:215)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:390)
> 	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:483)
> 	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1296)
> 	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1293)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:415)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
> 	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1293)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message