sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandish Kumar HN <sanysand...@gmail.com>
Subject Re: Review Request 59346: SQOOP-3178 : Incremental Merging for Parquet File Format
Date Mon, 29 May 2017 06:48:33 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/59346/
-----------------------------------------------------------

(Updated May 29, 2017, 6:48 a.m.)


Review request for Sqoop, Boglarka Egyed, Attila Szabo, and Szabolcs Vasas.


Changes
-------

With fixes


Bugs: PARQUET-1010 and SQOOP-3178
    https://issues.apache.org/jira/browse/PARQUET-1010
    https://issues.apache.org/jira/browse/SQOOP-3178


Repository: sqoop-trunk


Description
-------

New feature for sqoop-1: Sqoop Merge and Incremental Merge for Parquet File Format


Diffs (updated)
-----

  src/java/org/apache/sqoop/mapreduce/MergeGenericRecordExportMapper.java PRE-CREATION 
  src/java/org/apache/sqoop/mapreduce/MergeJob.java 8b1cba3 
  src/java/org/apache/sqoop/mapreduce/MergeParquetMapper.java PRE-CREATION 
  src/java/org/apache/sqoop/mapreduce/MergeParquetReducer.java PRE-CREATION 
  src/java/org/apache/sqoop/tool/ImportTool.java 4b1b12d 
  src/test/com/cloudera/sqoop/TestMerge.java 114e934 


Diff: https://reviews.apache.org/r/59346/diff/3/

Changes: https://reviews.apache.org/r/59346/diff/2-3/


Testing
-------

Hi,

 I have written a Sqoop Merge and Incremental Merge MR for Parquet File Format and I have
tested with million records of data with N number of iterations. Please review My patch.

THIS ISSUE HAS DEPENDANCY ON PARQUET BUG. SO I HAVE RESOLVED THE PARQUET ISSUE AND CREATED
A PATCH FOR IT HERE https://issues.apache.org/jira/browse/PARQUET-1010

Please let me know if there are any mistakes in My patch


Thanks,

Sandish Kumar HN


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message