hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-21565) Utilities::isEmptyPath should throw back FNFE instead of returning true
Date Tue, 02 Apr 2019 14:19:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rajesh Balamohan updated HIVE-21565:
------------------------------------
    Status: Patch Available  (was: Open)

> Utilities::isEmptyPath should throw back FNFE instead of returning true
> -----------------------------------------------------------------------
>
>                 Key: HIVE-21565
>                 URL: https://issues.apache.org/jira/browse/HIVE-21565
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Rajesh Balamohan
>            Priority: Trivial
>         Attachments: HIVE-21565.1.patch
>
>
> In case there is a {{viewfs}} configured and it ends up throwing FNFE, current codepath
silently ignores the error and ends up creating an empty file. 
> {noformat}
> at org.apache.hadoop.fs.viewfs.InodeTree.resolve(InodeTree.java:403)
> 	at org.apache.hadoop.fs.viewfs.ViewFileSystem.listStatus(ViewFileSystem.java:374)
> 	at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1497)
> 	at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1537)
> 	at org.apache.hadoop.hive.ql.exec.Utilities.isEmptyPath(Utilities.java:2350)
> 	at org.apache.hadoop.hive.ql.exec.Utilities.isEmptyPath(Utilities.java:2343)
> 	at org.apache.hadoop.hive.ql.exec.Utilities$GetInputPathsCallable.call(Utilities.java:3128)
> 	at org.apache.hadoop.hive.ql.exec.Utilities.getInputPaths(Utilities.java:3092)
> 	at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.cloneJobConf(SparkPlanGenerator.java:303)
> 	at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.generate(SparkPlanGenerator.java:226)
> 	at org.apache.hadoop.hive.ql.exec.spark.SparkPlanGenerator.generate(SparkPlanGenerator.java:109)
> 	at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:346)
> 	at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:358)
> 	at org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:323)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message