sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj" <vbasava...@cloudera.com>
Subject Re: Review Request 28828: IDF API changes
Date Tue, 09 Dec 2014 02:22:42 GMT


> On Dec. 8, 2014, 6:06 p.m., Abraham Elmahrek wrote:
> > spi/src/main/java/org/apache/sqoop/idf/IntermediateDataFormat.java, line 53
> > <https://reviews.apache.org/r/28828/diff/2/?file=786101#file786101line53>
> >
> >     This is not seen by connector developers. It does not belong in the SPI.

See comments from Jarceck, he suggested spi or core. 

I chose SPI : It is not seen by connector developer is not completely right. thay may also
want to adda new IDF. why not


> On Dec. 8, 2014, 6:06 p.m., Abraham Elmahrek wrote:
> > spi/src/main/java/org/apache/sqoop/idf/IntermediateDataFormat.java, line 93
> > <https://reviews.apache.org/r/28828/diff/2/?file=786101#file786101line93>
> >
> >     The intermediate data format may not be a CSV. This should not be setSqoopCSVData.

see the JIRA, please I have had 2 weeks long discussion there, I would really appreciate if
you follow that discussion there


> On Dec. 8, 2014, 6:06 p.m., Abraham Elmahrek wrote:
> > connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcConnector.java,
lines 100-103
> > <https://reviews.apache.org/r/28828/diff/2/?file=786078#file786078line100>
> >
> >     Just being more explicit?

if you see the changes made, it is obvious why it is so,

the spi having dependency on sdk is plain incorrect,


- Veena


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28828/#review64329
-----------------------------------------------------------


On Dec. 8, 2014, 3:13 p.m., Veena Basavaraj wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/28828/
> -----------------------------------------------------------
> 
> (Updated Dec. 8, 2014, 3:13 p.m.)
> 
> 
> Review request for Sqoop.
> 
> 
> Bugs: SQOOP-1811
>     https://issues.apache.org/jira/browse/SQOOP-1811
> 
> 
> Repository: sqoop-sqoop2
> 
> 
> Description
> -------
> 
> see jira
> 
> 
> Diffs
> -----
> 
>   connector/connector-generic-jdbc/pom.xml fc6cab4 
>   connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcConnector.java
c233ed5 
>   connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsConnector.java
f70142d 
>   connector/connector-kite/pom.xml 10ed099 
>   connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteConnector.java
c864882 
>   connector/connector-sdk/pom.xml 38c217a 
>   connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/CSVIntermediateDataFormat.java
daa51eb 
>   connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/CSVIntermediateDataFormatError.java
PRE-CREATION 
>   connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/IntermediateDataFormat.java
253dfba 
>   connector/connector-sdk/src/main/java/org/apache/sqoop/connector/idf/IntermediateDataFormatError.java
4b0dd88 
>   connector/connector-sdk/src/test/java/org/apache/sqoop/connector/idf/TestCSVIntermediateDataFormat.java
e66c897 
>   core/pom.xml 2b6e436 
>   core/src/main/java/org/apache/sqoop/driver/JobManager.java f4f5561 
>   core/src/main/java/org/apache/sqoop/driver/JobRequest.java eed79a5 
>   execution/mapreduce/pom.xml b23b905 
>   execution/mapreduce/src/main/java/org/apache/sqoop/job/io/SqoopWritable.java 05b731a

>   execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopMapper.java b9dd11d

>   execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopOutputFormatLoadExecutor.java
49a66b9 
>   execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMapReduce.java bbac7d2 
>   execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMatching.java a64a4a6 
>   execution/mapreduce/src/test/java/org/apache/sqoop/job/mr/TestSqoopOutputFormatLoadExecutor.java
7c40ad5 
>   execution/mapreduce/src/test/java/org/apache/sqoop/job/util/MRJobTestUtil.java 5d5359e

>   spi/pom.xml 43f17d4 
>   spi/src/main/java/org/apache/sqoop/connector/spi/SqoopConnector.java ff6392e 
>   spi/src/main/java/org/apache/sqoop/idf/IntermediateDataFormat.java PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/28828/diff/
> 
> 
> Testing
> -------
> 
> 
> Thanks,
> 
> Veena Basavaraj
> 
>


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message