hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zoltan Haindrich (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18237) missing results for insert_only table after DP insert
Date Wed, 06 Dec 2017 21:17:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280931#comment-16280931
] 

Zoltan Haindrich commented on HIVE-18237:
-----------------------------------------

well..all I know is: in the above {{insert overwrite}} case the data layout(physically) seems
like to be the "non-mm" version; this could be fixed in 2 ways:

* like patch#01; correct somehow the partition scanning logic to do the right type of scan
* correct the writers to use the layout which this method is expecting.

if the latter is the preferred...then I've to say that: I'm not sure how to do that; so feel
free to take it over.... :)

> missing results for insert_only table after DP insert
> -----------------------------------------------------
>
>                 Key: HIVE-18237
>                 URL: https://issues.apache.org/jira/browse/HIVE-18237
>             Project: Hive
>          Issue Type: Bug
>          Components: Transactions
>            Reporter: Zoltan Haindrich
>            Assignee: Zoltan Haindrich
>         Attachments: HIVE-18237.01.patch
>
>
> {code}
> set hive.stats.column.autogather=false;
> set hive.exec.dynamic.partition.mode=nonstrict;
> set hive.exec.max.dynamic.partitions.pernode=200;
> set hive.exec.max.dynamic.partitions=200;
> set hive.support.concurrency=true;
> set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
> create table i0 (p int,v int);
> insert into i0 values
>         (0,0),
>         (2,2),
>         (3,3);
> create table p0 (v int) partitioned by (p int) stored as orc 
>   tblproperties ("transactional"="true", "transactional_properties"="insert_only");
> explain insert overwrite table p0 partition (p) select * from i0 where v < 3;
> insert overwrite table p0 partition (p) select * from i0 where v < 3;
> select count(*) from p0 where v!=1;
> {code}
> The table p0 should contain {{2}} rows at this point; but the result is {{0}}.
> * seems to be specific to insert_only tables
> * the existing data appears if an {{insert into}} is executed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message