sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-1869) Sqoop2: Expend schema matching to support two schemaless connectors
Date Tue, 09 Dec 2014 17:16:14 GMT
Gwen Shapira created SQOOP-1869:
-----------------------------------

             Summary: Sqoop2: Expend schema matching to support two schemaless connectors
                 Key: SQOOP-1869
                 URL: https://issues.apache.org/jira/browse/SQOOP-1869
             Project: Sqoop
          Issue Type: Improvement
            Reporter: Gwen Shapira
            Assignee: Gwen Shapira


Currently the schema matches errors out if both FROM and TO connectors are empty. This prevents
us from supporting HDFS->Kafka.

I suggest to change the code to support the following:
1. Empty schema will contain a single byte[] field with whatever the connector writes into
it.
2. As happens now, one connector is null and the other has a schema, the schema that exists
will be used to parse the data.
3. If we have two empty schemas, the TO connector will get a byte[] and presumably know what
to do with it.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message