sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1706) Add API doc for the IDF interface and Schema -> ColumnTypes
Date Wed, 10 Dec 2014 00:11:14 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14240357#comment-14240357

Gwen Shapira commented on SQOOP-1706:

Wiki is a bit of an issue as one source of truth. 

The connector developer .rst is versioned, so if I download Sqoop 1.99.4, I get instructions
on how to write connectors for this specific version.
The wiki may change between versions, so if the wiki says to call "IDF.getCSVData", it won't
work with certain versions and it will become really confusing to specify which is which.

Kafka has this issue with the protocol documentation - which has a certain version of the
wire protocol, which may or may not match what is running on your servers.

> Add API doc for the IDF interface and Schema -> ColumnTypes
> -----------------------------------------------------------
>                 Key: SQOOP-1706
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1706
>             Project: Sqoop
>          Issue Type: Sub-task
>          Components: sqoop2-framework
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>         Attachments: FromTo_Schema_IDF.001.png
> Since there can be multiple implementation of the IDF and connectors can chose to use
a their specific implementation for IDF, document this as a PUBLIC apis
> Schema is part of the IDF interface and it is important to explain the different column
types we support and how in one of the implementations we has certain assumptions for parsing
from string to obejct

This message was sent by Atlassian JIRA

View raw message