sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jilani Shaik <jilani2...@gmail.com>
Subject Re: Review Request 57499: Sqoop incremental import - NULL column updates are not pulled into HBase table
Date Mon, 27 Mar 2017 09:42:34 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated March 27, 2017, 9:42 a.m.)

Review request for Sqoop.


Updated indentation issues
Added unit test to validate null column update in HBase incremental import

Bugs: SQOOP-3149

Repository: sqoop-trunk


HBase delete is added as part of incremental data import, Modified the return type of method
which is responsible for holding list of Put objects to List of Mutation objects and at the
time of execution of insert or delete using the type of object in Mutation, executed the actaul
operation either insert or delete.

Jira ticket for the same: https://issues.apache.org/jira/browse/SQOOP-3149

Similar ticket to above:  SQOOP-3125

Diffs (updated)

  src/java/org/apache/sqoop/hbase/HBasePutProcessor.java fdbe1276 
  src/java/org/apache/sqoop/hbase/PutTransformer.java 533467e5 
  src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java 363e1456 
  src/java/org/apache/sqoop/mapreduce/HBaseBulkImportMapper.java 58ccee7b 
  src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java fa14a013 
  src/test/com/cloudera/sqoop/hbase/HBaseTestCase.java a054eb66 
  src/test/com/cloudera/sqoop/testutil/BaseSqoopTestCase.java 6310a398 

Diff: https://reviews.apache.org/r/57499/diff/2/

Changes: https://reviews.apache.org/r/57499/diff/1-2/


Executed with jar prepared with these changes into hadoop cluster and tested bot import and
then incremental import.

File Attachments

HBase delete support for incremental import
updated with unit test and based on below suggestions


Jilani Shaik

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message