hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Yeom (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18237) missing results for insert_only table after DP insert
Date Sat, 09 Dec 2017 03:02:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284557#comment-16284557
] 

Steve Yeom commented on HIVE-18237:
-----------------------------------

Hi Zoltan, 

I hope I did not interrupt you at your Jira efforts. 
The context at  loadDynamicPartitions() for the test case is 
1. INSERT OVERWRITE
2. Micro-managed table (or transactional + insert_only).
The current code is not handling that case correctly. 

So I quickly created a patch in that method for my HIVE-18052 efforts for testing. Will let
you know if you are OK.

> missing results for insert_only table after DP insert
> -----------------------------------------------------
>
>                 Key: HIVE-18237
>                 URL: https://issues.apache.org/jira/browse/HIVE-18237
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>            Reporter: Zoltan Haindrich
>            Assignee: Zoltan Haindrich
>         Attachments: HIVE-18237.01.patch
>
>
> {code}
> set hive.stats.column.autogather=false;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.exec.max.dynamic.partitions.pernode=200;
> set hive.exec.max.dynamic.partitions=200;
> set hive.support.concurrency=true;
> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
> create table i0 (p int,v int);
> insert into i0 values
>         (0,0),
>         (2,2),
>         (3,3);
> create table p0 (v int) partitioned by (p int) stored as orc 
>   tblproperties ("transactional"="true", "transactional_properties"="insert_only");
> explain insert overwrite table p0 partition (p) select * from i0 where v < 3;
> insert overwrite table p0 partition (p) select * from i0 where v < 3;
> select count(*) from p0 where v!=1;
> {code}
> The table p0 should contain {{2}} rows at this point; but the result is {{0}}.
> * seems to be specific to insert_only tables
> * the existing data appears if an {{insert into}} is executed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message