sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suraj Nayak (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-3138) Netezza Direct Import does not support --columns options
Date Tue, 21 Feb 2017 00:48:44 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Suraj Nayak updated SQOOP-3138:
-------------------------------
    Description: 
Netezza Direct import Mapper is not sensitive to {{columns}} option. The parameters passed
to {{--columns C1,C2,C3,C4}} are ignored by {{NetezzaExternalTableImportMapper}}. 

[NetezzaExternalTableImportMapper|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L83]
on line 83 is based of [output field names| https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java#L420]
instead of input field names. 

Even when -D mapreduce.jdbc.output.field.names=C1,C2,C3,C4 is set, another bug in [NetezzaExternalTableImportMapper
@ line 128|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L128]
duplicates the first column. This is due to the for loop initialization bug where variable
{{i}} should be initialized to {{1}} instead of {{0}}. 

  was:
Netezza Direct import Mapper is not sensitive to --columns. The parameters passed to --columns
C1,C2,C3,C4 are ignored by {{NetezzaExternalTableImportMapper}}. 

[NetezzaExternalTableImportMapper|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L83]
on line 83 is based of [output field names| https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java#L420]
instead of input field names. 

Even when -D mapreduce.jdbc.output.field.names=C1,C2,C3,C4 is set, another bug in [NetezzaExternalTableImportMapper
@ line 128|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L128]
duplicates the first column. This is due to the for loop initialization bug where variable
{{i}} should be initialized to {{1}} instead of {{0}}. 


> Netezza Direct Import does not support --columns options
> --------------------------------------------------------
>
>                 Key: SQOOP-3138
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3138
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors
>    Affects Versions: 1.4.6
>            Reporter: Suraj Nayak
>            Priority: Minor
>
> Netezza Direct import Mapper is not sensitive to {{columns}} option. The parameters passed
to {{--columns C1,C2,C3,C4}} are ignored by {{NetezzaExternalTableImportMapper}}. 
> [NetezzaExternalTableImportMapper|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L83]
on line 83 is based of [output field names| https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/DBConfiguration.java#L420]
instead of input field names. 
> Even when -D mapreduce.jdbc.output.field.names=C1,C2,C3,C4 is set, another bug in [NetezzaExternalTableImportMapper
@ line 128|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/mapreduce/db/netezza/NetezzaExternalTableImportMapper.java#L128]
duplicates the first column. This is due to the for loop initialization bug where variable
{{i}} should be initialized to {{1}} instead of {{0}}. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message