hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18202) Automatically migrate hbase.table.name to hbase.mapreduce.hfileoutputformat.table.name for hbase-based table
Date Thu, 07 Dec 2017 19:20:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282368#comment-16282368
] 

Aihua Xu commented on HIVE-18202:
---------------------------------

[~ngangam] Thanks for reviewing. Hadoop3 will be compatible with HBase2, not with HBase1.
It may not be a good idea to have both properties since that will have inconsistency with
the newly created tables (which will only have one property). Yeah, it will be backward incompatible.


> Automatically migrate hbase.table.name to hbase.mapreduce.hfileoutputformat.table.name
for hbase-based table
> ------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-18202
>                 URL: https://issues.apache.org/jira/browse/HIVE-18202
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HBase Handler
>    Affects Versions: 3.0.0
>            Reporter: Aihua Xu
>            Assignee: Aihua Xu
>         Attachments: HIVE-18202.1.patch
>
>
> The property name for Hbase table mapping is changed from hbase.table.name to hbase.mapreduce.hfileoutputformat.table.name
in HBase 2.
> We can include such upgrade for existing hbase-based tables in DB upgrade script to automatically
change such values.
> For the new tables, the query will be like:
> create table hbase_table(key int, val string) stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
with serdeproperties ('hbase.columns.mapping' = ':key,cf:val') tblproperties ('hbase.mapreduce.hfileoutputformat.table.name'
= 'positive_hbase_handler_bulk')



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message