sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boglarka Egyed (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3138) Netezza Direct Import does not support --columns options
Date Thu, 23 Feb 2017 10:02:44 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15880212#comment-15880212

Boglarka Egyed commented on SQOOP-3138:

I have found that you already did, [~snayakm], so I have linked it to this ticket.

> Netezza Direct Import does not support --columns options
> --------------------------------------------------------
>                 Key: SQOOP-3138
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3138
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors
>    Affects Versions: 1.4.6
>            Reporter: Suraj Nayak
>            Priority: Minor
>         Attachments: SQOOP-3138.patch
> Netezza Direct import Mapper is not sensitive to {{columns}} option. The parameters passed
to {{--columns C1,C2,C3,C4}} are ignored by {{NetezzaExternalTableImportMapper}}. 
> [NetezzaExternalTableImportMapper|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L83]
on line 83 is based of [output field names| https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java#L420]
instead of input field names. 
> Even when -D mapreduce.jdbc.output.field.names=C1,C2,C3,C4 is set, another bug in [NetezzaExternalTableImportMapper
@ line 128|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L128]
duplicates the first column. This is due to the for loop initialization bug where variable
{{i}} should be initialized to {{1}} instead of {{0}}. 

This message was sent by Atlassian JIRA

View raw message