sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Qian Xu" <sx.a...@googlemail.com>
Subject Re: Review Request 26963: SQOOP-1588: TO-side of Kite Connector - Write data to HDFS
Date Tue, 21 Oct 2014 07:07:16 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26963/
-----------------------------------------------------------

(Updated Oct. 21, 2014, 3:07 p.m.)


Review request for Sqoop.


Changes
-------

Leave 4 comments open and responsed the rest 11 items.


Bugs: SQOOP-1588
    https://issues.apache.org/jira/browse/SQOOP-1588


Repository: sqoop-sqoop2


Description
-------

Create a basic Kite connector that can write data (i.e. from a jdbc connection) to HDFS.

The scope is defined as follows:
* Destination: HDFS
* File Format: Avro Parquet and CSV.
* Compression Codec: Use default
* Partitioner Strategy: Not supported
* Column Mapping: Not supported


Diffs (updated)
-----

  connector/connector-kite/pom.xml PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConfigUpgrader.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnector.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnectorError.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConstants.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteLoader.java PRE-CREATION

  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToDestroyer.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToInitializer.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteValidator.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/LinkConfig.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/LinkConfiguration.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/ToFormat.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/ToJobConfig.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/ToJobConfiguration.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/util/KiteDataTypeUtil.java
PRE-CREATION 
  connector/connector-kite/src/main/resources/kite-connector-config.properties PRE-CREATION

  connector/connector-kite/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteExecutor.java
PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteLoader.java
PRE-CREATION 
  connector/connector-kite/src/test/resources/log4j.properties PRE-CREATION 
  connector/pom.xml e98a0fc 
  execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopDestroyerExecutor.java b385926

  pom.xml f25a29f 
  server/pom.xml 67baaa5 
  test/pom.xml 7a80710 

Diff: https://reviews.apache.org/r/26963/diff/


Testing
-------

New unittests included. All passed.


Thanks,

Qian Xu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message