sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Qian Xu" <sx.a...@googlemail.com>
Subject Re: Review Request 26963: SQOOP-1588: TO-side of Kite Connector - Write data to HDFS
Date Mon, 17 Nov 2014 07:31:16 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26963/
-----------------------------------------------------------

(Updated Nov. 17, 2014, 3:31 p.m.)


Review request for Sqoop.


Changes
-------

(1) updated code regarding review comments (thanks Veena) (2) refactored code regarding recent
spi changes


Bugs: SQOOP-1588
    https://issues.apache.org/jira/browse/SQOOP-1588


Repository: sqoop-sqoop2


Description
-------

Create a basic Kite connector that can write data (i.e. from a jdbc connection) to HDFS.

The scope is defined as follows:
* Destination: HDFS
* File Format: Avro Parquet and CSV.
* Compression Codec: Use default
* Partitioner Strategy: Not supported
* Column Mapping: Not supported


Diffs (updated)
-----

  connector/connector-kite/pom.xml PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnector.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnectorConstants.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnectorError.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteLoader.java PRE-CREATION

  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToDestroyer.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToInitializer.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/LinkConfig.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/LinkConfiguration.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/ToJobConfig.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/ToJobConfiguration.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/util/InputValidation.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/util/KiteDataTypeUtil.java
PRE-CREATION 
  connector/connector-kite/src/main/resources/connector-configs.properties PRE-CREATION 
  connector/connector-kite/src/main/resources/kite-connector-config.properties PRE-CREATION

  connector/connector-kite/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteExecutor.java
PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteLoader.java
PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteToDestroyer.java
PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteToInitializer.java
PRE-CREATION 
  connector/connector-kite/src/test/resources/log4j.properties PRE-CREATION 
  connector/connector-sdk/src/main/java/org/apache/sqoop/connector/common/FileFormat.java
PRE-CREATION 
  connector/connector-sdk/src/main/java/org/apache/sqoop/connector/common/JarUtil.java PRE-CREATION

  connector/pom.xml e98a0fc 
  pom.xml 233d3ce 
  server/pom.xml 4a5eb5e 
  test/pom.xml 2dbb8c5 

Diff: https://reviews.apache.org/r/26963/diff/


Testing
-------

New unittests included. All passed.


Thanks,

Qian Xu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message