sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shruti Joshi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1038) Add support for composite keys in HBase import
Date Tue, 28 May 2013 12:07:23 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13668264#comment-13668264
] 

Shruti Joshi commented on SQOOP-1038:
-------------------------------------

Hi Jarek,

I have done following changes in code:
1) While performing HBase import in Sqoop, if the row-key column or the column-family is null,
a warning message will be logged and an IOException will be thrown to indicate failure.

2) To support composite-key table import in HBase, user will specify comma separated list
of keys. The ‘isCompositeKey’ method will check if the specified row-key is a composite
key.

3) The logic to write record data in HBase does not vary for composite-key or a single key
table and hence I have created a new method to insert data in HBase which will be common for
both the cases. 
(Please verify the method putRecordInHBase())

4) Added a new method getCompositeKey() to construct hbase row-key from attribute values belonging
to the composite key.

5) Tested the code with both single and composite key tables. Also ran ‘ant checkstyle’
which results in successful build.


                
> Add support for composite keys in HBase import
> ----------------------------------------------
>
>                 Key: SQOOP-1038
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1038
>             Project: Sqoop
>          Issue Type: New Feature
>    Affects Versions: 1.4.3
>            Reporter: Shruti Joshi
>            Assignee: Shruti Joshi
>         Attachments: HBase sqoop import for table with composite key.docx, sqoop_trunk.patch
>
>
> Sqoop does not support importing data into hbase when table contains composite key.
> Ref: https://issues.cloudera.org/browse/SQOOP-107

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message