sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-864) Sqoop2: Introduce ETL context objects
Date Sun, 10 Feb 2013 22:13:13 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575555#comment-13575555
] 

Hudson commented on SQOOP-864:
------------------------------

Integrated in Sqoop2-hadoop200 #187 (See [https://builds.apache.org/job/Sqoop2-hadoop200/187/])
    SQOOP-864: Introduce ETL context objects (Revision ed9c514361b508b739c76df31d7719660f095bd3)

     Result = SUCCESS
cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed9c514361b508b739c76df31d7719660f095bd3
Files : 
* common/src/main/java/org/apache/sqoop/job/etl/LoaderContext.java
* spi/src/main/java/org/apache/sqoop/job/etl/Loader.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsExportPartitioner.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestImportExtractor.java
* common/src/main/java/org/apache/sqoop/job/etl/ExtractorContext.java
* spi/src/main/java/org/apache/sqoop/job/io/DataReader.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExportLoader.java
* common/src/main/java/org/apache/sqoop/job/etl/ActorContext.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExportLoader.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopDestroyerExecutor.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopInputFormat.java
* spi/src/main/java/org/apache/sqoop/job/etl/Initializer.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportInitializer.java
* common/src/main/java/org/apache/sqoop/job/etl/PartitionerContext.java
* common/src/main/java/org/apache/sqoop/etl/io/DataWriter.java
* spi/src/main/java/org/apache/sqoop/job/etl/Extractor.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsExtract.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestImportInitializer.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMapReduce.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/mr/TestSqoopOutputFormatLoadExecutor.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceImportLoader.java
* common/src/main/java/org/apache/sqoop/job/etl/DestroyerContext.java
* spi/src/main/java/org/apache/sqoop/job/etl/Destroyer.java
* common/src/main/java/org/apache/sqoop/etl/io/DataReader.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportDestroyer.java
* spi/src/main/java/org/apache/sqoop/job/io/DataWriter.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExportDestroyer.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceExportExtractor.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExportInitializer.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextExportExtractor.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopMapper.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportPartitioner.java
* common/src/main/java/org/apache/sqoop/job/etl/InitializerContext.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportExtractor.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopOutputFormatLoadExecutor.java
* spi/src/main/java/org/apache/sqoop/job/etl/Partitioner.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsLoad.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextImportLoader.java
* core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExportInitializer.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestImportPartitioner.java

                
> Sqoop2: Introduce ETL context objects
> -------------------------------------
>
>                 Key: SQOOP-864
>                 URL: https://issues.apache.org/jira/browse/SQOOP-864
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.99.1
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>             Fix For: 1.99.2
>
>         Attachments: bugSQOOP-864.patch, bugSQOOP-864.patch, bugSQOOP-864.patch
>
>
> I've came to a need to add new parameter into Extractor.extract and Loader.load methods.
I've realized that doing so will break backward compatibility as both classes are part of
public API for connectors. Right now it's not an issue as that API not stable yet, but it
would be nice to create more generic approach that will allow us to extend it in the future
without breaking backward compatibility.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message