sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1678) Sqoop2: [HDFS Connector] Configurable null values
Date Thu, 11 Dec 2014 04:56:13 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14242152#comment-14242152
] 

Hudson commented on SQOOP-1678:
-------------------------------

FAILURE: Integrated in Sqoop2-hadoop100 #718 (See [https://builds.apache.org/job/Sqoop2-hadoop100/718/])
SQOOP-1678: Sqoop2: [HDFS Connector] Configurable null values (venkat: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=c820aaf870ddfacc1039f559b138cb9e72b0a287)
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/configuration/FromJobConfig.java
* connector/connector-hdfs/src/test/java/org/apache/sqoop/connector/hdfs/TestHdfsBase.java
* connector/connector-hdfs/src/main/resources/hdfs-connector-config.properties
* connector/connector-hdfs/src/test/java/org/apache/sqoop/connector/hdfs/TestLoader.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsUtils.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/configuration/ToJobConfig.java
* connector/connector-hdfs/src/test/java/org/apache/sqoop/connector/hdfs/TestHdfsUtils.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsLoader.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsConstants.java
* connector/connector-hdfs/src/test/java/org/apache/sqoop/connector/hdfs/TestExtractor.java
* connector/connector-hdfs/src/main/java/org/apache/sqoop/connector/hdfs/HdfsExtractor.java


> Sqoop2: [HDFS Connector] Configurable null values
> -------------------------------------------------
>
>                 Key: SQOOP-1678
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1678
>             Project: Sqoop
>          Issue Type: Improvement
>          Components: sqoop2-hdfs-connector
>    Affects Versions: 1.99.4
>            Reporter: Abraham Elmahrek
>            Assignee: Abraham Elmahrek
>             Fix For: 1.99.5
>
>         Attachments: SQOOP-1678.0.patch, SQOOP-1678.1.patch, SQOOP-1678.2.patch, SQOOP-1678.3.patch
>
>
> Jobs should be able to define what the null values look like.
> Simple table:
> {noformat}
> +-------+-------------+------+-----+---------+-------+
> | Field | Type        | Null | Key | Default | Extra |
> +-------+-------------+------+-----+---------+-------+
> | id    | int(11)     | NO   | PRI | 0       |       |
> | name  | varchar(35) | YES  |     | NULL    |       |
> +-------+-------------+------+-----+---------+-------+
> {noformat}
> Content:
> {noformat}
> +----+------+
> | id | name |
> +----+------+
> |  1 |      |
> |  2 | test |
> +----+------+
> 2 rows in set (0.00 sec)
> {noformat}
> Assuming the above blank "name" is null, then we should be able to tell the HDFS connector
to choose different representations of NULL. Current default is NULL, but a blank value may
be preferred instead:
> {noformat}
> 1,NULL
> {noformat}
> or
> {noformat}
> 1,
> {noformat}
> or
> {noformat}
> 1,-
> {noformat}
> etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message