sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Masatake Iwasaki" <iwasak...@oss.nttdata.co.jp>
Subject Re: Review Request 27187: SQOOP-1622: Copying from staging table should be in single transaction for pg_bulkload connector
Date Sun, 26 Oct 2014 21:09:28 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27187/
-----------------------------------------------------------

(Updated Oct. 26, 2014, 9:09 p.m.)


Review request for Sqoop.


Changes
-------

I updated the patch to fix in more straight forward way.


Bugs: SQOOP-1622
    https://issues.apache.org/jira/browse/SQOOP-1622


Repository: sqoop-trunk


Description
-------

PGBulkloadExportReducer#reduce may be called per map task because the map output key is unique
ID of map task. This patch fixed the map output key to make reduce tasks do work in single
transaction.
This patch include trivial fixes in test code.


Diffs (updated)
-----

  src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java 32fe077 
  src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java 16af84c 
  src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java 3dc05a7 
  src/test/com/cloudera/sqoop/manager/PGBulkloadManagerManualTest.java fc5fd6d 

Diff: https://reviews.apache.org/r/27187/diff/


Testing
-------

PGBulkloadManagerManualTest passed.


Thanks,

Masatake Iwasaki


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message