hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Koifman (JIRA)" <>
Subject [jira] [Updated] (HIVE-17214) check/fix conversion of unbucketed non-acid to acid
Date Mon, 16 Oct 2017 19:00:02 GMT


Eugene Koifman updated HIVE-17214:
       Resolution: Fixed
    Fix Version/s: 3.0.0
           Status: Resolved  (was: Patch Available)

committed to master (Hive 3.0)
thanks Sergey for the review

> check/fix conversion of unbucketed non-acid to acid
> ---------------------------------------------------
>                 Key: HIVE-17214
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Transactions
>            Reporter: Eugene Koifman
>            Assignee: Eugene Koifman
>            Priority: Minor
>             Fix For: 3.0.0
>         Attachments: HIVE-17214.01.patch
> bucketed tables have stricter rules for file layout on disk - bucket files are direct
children of a partition directory.
> for un-bucketed tables I'm not sure there are any rules
> for example, CTAS with Tez + Union operator creates 1 directory for each leg of the union
> Supposedly Hive can read table by picking all files recursively.  
> Can it also write (other than CTAS example above) arbitrarily?
> Does it mean Acid write can also write anywhere?
> Figure out what can be supported and how can existing layout can be checked?  Examining
a full "ls -l -R" for a large table could be expensive. 

This message was sent by Atlassian JIRA

View raw message