sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jilani Shaik <jilani2...@gmail.com>
Subject Re: Review Request 57499: Sqoop incremental import - NULL column updates are not pulled into HBase table
Date Wed, 12 Jul 2017 05:20:57 GMT

This is an automatically generated e-mail. To reply, visit:

(Updated July 12, 2017, 5:20 a.m.)

Review request for Sqoop, Boglarka Egyed, Attila Szabo, and Anna Szonyi.


fixed white space issue

Bugs: SQOOP-3149

Repository: sqoop-trunk


HBase delete is added as part of incremental data import, Modified the return type of method
which is responsible for holding list of Put objects to List of Mutation objects and at the
time of execution of insert or delete using the type of object in Mutation, executed the actaul
operation either insert or delete.

Jira ticket for the same: https://issues.apache.org/jira/browse/SQOOP-3149

Similar ticket to above:  SQOOP-3125

Diffs (updated)

  src/java/org/apache/sqoop/hbase/HBasePutProcessor.java fdbe1276 
  src/java/org/apache/sqoop/hbase/PutTransformer.java 533467e5 
  src/java/org/apache/sqoop/hbase/ToStringPutTransformer.java 363e1456 
  src/java/org/apache/sqoop/mapreduce/HBaseBulkImportMapper.java 58ccee7b 
  src/test/com/cloudera/sqoop/hbase/HBaseImportTest.java fa14a013 
  src/test/com/cloudera/sqoop/hbase/HBaseTestCase.java a054eb66 
  src/test/com/cloudera/sqoop/testutil/BaseSqoopTestCase.java 6310a398 

Diff: https://reviews.apache.org/r/57499/diff/9/

Changes: https://reviews.apache.org/r/57499/diff/8-9/


Executed with jar prepared with these changes into hadoop cluster and tested bot import and
then incremental import.

File Attachments

HBase delete support for incremental import
updated with unit test and based on below suggestions


Jilani Shaik

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message