sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Szabolcs Vasas <vasas.szabo...@gmail.com>
Subject Review Request 67929: Remove Kite dependency from the Sqoop project
Date Mon, 16 Jul 2018 15:56:18 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/67929/
-----------------------------------------------------------

Review request for Sqoop.


Bugs: SQOOP-3329
    https://issues.apache.org/jira/browse/SQOOP-3329


Repository: sqoop-trunk


Description
-------

- Removed kitesdk dependency from ivy.xml
- Removed Kite Dataset API based Parquet import implementation
- Since Parquet library was a transitive dependency of the Kite SDK I added org.apache.parquet.avro-parquet
1.9 as a direct dependency
- In this dependency the parquet package has changed to org.apache.parquet so I needed to
make changes in several classes according to this
- Removed all the Parquet related test cases from TestHiveImport. These scenarios are already
covered in TestHiveServer2ParquetImport.
- Modified the documentation to reflect these changes.


Diffs
-----

  ivy.xml 1f587f3eb 
  ivy/libraries.properties 565a8bf50 
  src/docs/user/hive-notes.txt af97d94b3 
  src/docs/user/import.txt a2c16d956 
  src/java/org/apache/sqoop/SqoopOptions.java cc1b75281 
  src/java/org/apache/sqoop/avro/AvroUtil.java 1663b1d1a 
  src/java/org/apache/sqoop/mapreduce/parquet/ParquetJobConfiguratorImplementation.java 050c85488

  src/java/org/apache/sqoop/mapreduce/parquet/hadoop/HadoopParquetExportJobConfigurator.java
2180cc20e 
  src/java/org/apache/sqoop/mapreduce/parquet/hadoop/HadoopParquetImportJobConfigurator.java
90b910a34 
  src/java/org/apache/sqoop/mapreduce/parquet/hadoop/HadoopParquetMergeJobConfigurator.java
66ebc5b80 
  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteMergeParquetReducer.java 02816d77f

  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetExportJobConfigurator.java 6ebc5a31b

  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetExportMapper.java 122ff3fc9

  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetImportJobConfigurator.java 7e179a27d

  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetImportMapper.java 0a91e4a20

  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetJobConfiguratorFactory.java
bd07c09f4 
  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetMergeJobConfigurator.java ed045cd14

  src/java/org/apache/sqoop/mapreduce/parquet/kite/KiteParquetUtils.java a4768c932 
  src/java/org/apache/sqoop/tool/BaseSqoopTool.java 87fc5e987 
  src/test/org/apache/sqoop/TestMerge.java 2b3280a5a 
  src/test/org/apache/sqoop/TestParquetExport.java 0fab1880c 
  src/test/org/apache/sqoop/TestParquetImport.java b1488e8af 
  src/test/org/apache/sqoop/TestParquetIncrementalImportMerge.java adad0cc11 
  src/test/org/apache/sqoop/hive/TestHiveImport.java 436f0e512 
  src/test/org/apache/sqoop/hive/TestHiveServer2ParquetImport.java b55179a4f 
  src/test/org/apache/sqoop/tool/TestBaseSqoopTool.java dbda8b7f4 
  src/test/org/apache/sqoop/util/ParquetReader.java f1c2fe10a 


Diff: https://reviews.apache.org/r/67929/diff/1/


Testing
-------

Ran unit and third party tests.


Thanks,

Szabolcs Vasas


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message