hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Deepak Jaiswal (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HIVE-17675) verify SMB join with multiple inserts
Date Mon, 11 Jun 2018 05:42:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-17675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Deepak Jaiswal resolved HIVE-17675.
-----------------------------------
    Resolution: Won't Fix

This only applies to ACID tables which sort the data using Row ID instead of sort column(s).
For such tables SMB wont happen. For other tables a new insert goes into different files and
SMB uses KeyValueMerger to merge data from those files.

> verify SMB join with multiple inserts
> -------------------------------------
>
>                 Key: HIVE-17675
>                 URL: https://issues.apache.org/jira/browse/HIVE-17675
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Deepak Jaiswal
>            Priority: Major
>
> Hive has a family of joins that interact with sorted and bucketed tables. Afaik one (all?)
of them actually rely on the table being sorted, rather than sorting it. 
> If one runs insert on such a table without merge more than once, there'd be 2+ files
for every bucket that are individually sorted; but globally, the table would no longer be
sorted.
> Would these joins work/disable themselves correctly in this case, or could it produce
incorrect results? We might need a q file.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message