sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Qian Xu" <qian.a...@intel.com>
Subject Re: Review Request 29090: SQOOP-1647: KiteConnector FROM-side HDFS
Date Thu, 08 Jan 2015 03:37:40 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/29090/
-----------------------------------------------------------

(Updated Jan. 8, 2015, 11:37 a.m.)


Review request for Sqoop.


Changes
-------

Rebased to current code base


Bugs: SQOOP-1647
    https://issues.apache.org/jira/browse/SQOOP-1647


Repository: sqoop-sqoop2


Description
-------

This JIRA proposes to support reading data from an HDFS dataset. 

Note that Kite SDK seems have limitation of opening multiple record reader instances by Sqoop
2's demand. This version supports only one partition.https://groups.google.com/a/cloudera.org/forum/#!mydiscussions/cdk-dev/2NJUvh0WmoY


Diffs (updated)
-----

  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnector.java
982d6dd 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnectorError.java
d67c8de 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
9432e4b 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetPartition.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetPartitioner.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteExtractor.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteFromDestroyer.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteFromInitializer.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteLoader.java b115242

  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToDestroyer.java
3b36f1d 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToInitializer.java
ad5898f 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/FromJobConfig.java
PRE-CREATION 
  connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/configuration/FromJobConfiguration.java
PRE-CREATION 
  connector/connector-kite/src/main/resources/kite-connector-config.properties 65541c5 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteExecutor.java
5e4edc5 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteExtractor.java
PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteFromInitializer.java
PRE-CREATION 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteToDestroyer.java
87ed906 
  connector/connector-kite/src/test/java/org/apache/sqoop/connector/kite/TestKiteToInitializer.java
fab31f9 
  connector/connector-sdk/src/main/java/org/apache/sqoop/connector/common/AvroDataTypeUtil.java
PRE-CREATION 
  pom.xml d1f0a45 

Diff: https://reviews.apache.org/r/29090/diff/


Testing
-------

Added new test cases.


Thanks,

Qian Xu


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message