spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "angerszhu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-28450) When scan hive data of a not existed partition, it return an error
Date Tue, 23 Jul 2019 06:52:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-28450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890713#comment-16890713
] 

angerszhu commented on SPARK-28450:
-----------------------------------

[~shivusondur@gmail.com]

Just select a partition table with an not exist table.

select * fromn partitiontable where part_col='not exist' ;

Since in hive we can just return a result of 0 row. In spark , it will catch this error in
HiveExternalCatalog. Maybe we should make it same as Hive?

> When scan hive data of a not existed partition, it return an error
> ------------------------------------------------------------------
>
>                 Key: SPARK-28450
>                 URL: https://issues.apache.org/jira/browse/SPARK-28450
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.4.0, 3.0.0
>            Reporter: angerszhu
>            Priority: Major
>         Attachments: image-2019-07-19-20-51-12-861.png
>
>
> When we select data of a un-existed hive partition table's partition, it will return
error, bu it should just return empty.
> !image-2019-07-19-20-51-12-861.png!



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message