sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Raviteja Lokineni (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1342) Sqoop Import Job Hangs when the Netezza direct option is used !
Date Tue, 28 Feb 2017 19:05:45 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15888684#comment-15888684
] 

Raviteja Lokineni commented on SQOOP-1342:
------------------------------------------

May be this could help: https://community.hortonworks.com/articles/73709/sqoop-import-for-netezza-connector-in-direct-mode.html

> Sqoop Import Job Hangs when the Netezza direct option is used !
> ---------------------------------------------------------------
>
>                 Key: SQOOP-1342
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1342
>             Project: Sqoop
>          Issue Type: Test
>          Components: sqoop2-test
>    Affects Versions: 1.4.4
>         Environment: sqoop-1.4.4.2.0.6.1-102.jar, nzjdbc3.jar
>            Reporter: Shyam
>              Labels: test
>   Original Estimate: 168h
>  Remaining Estimate: 168h
>
> Hi, The SQOOP Import job hangs when used with the Netezza --direct option. It runs fine
without the "--direct" option.
> Here is the SQOOP Job:
> --------------------------------------------------------------------------------------------
> /sqoop import --direct --connect "jdbc:netezza://netezza-1v:5480/DTSTTAPPL;schema=ADMIN;"
--table PROCEDURE  --username nzuser --P --target-dir /user/DTSTTAPPL/ --verbose -m 4
> --------------------------------------------------------------------------------------------
> The job hangs after saying that map 100% reduce 0%. I had to do a mapred job -kill.
> In looking at the Ambari, it looks like it read only 4 records. Basically 1 per mapper.
> In Looking at the YARN logs, I found the below error. 
> 2014-06-24 22:31:26,064 ERROR [Thread-15] org.apache.sqoop.mapreduce.db.netezza.NetezzaJDBCStatementRunner:
Unable to execute external table export
> org.netezza.error.NzSQLException: ERROR:  found delim ',' in a data field, specify escapeChar
'\' option in the external table definition
> There is only 1 Date Timestamp field in the table I'm trying to import and I did not
see a ','. Am i supposed to create an external table in Netezza before hand. My assumption
was using the "--direct" option will take care of creating the external table in Netezza and
dropping it later.
> Any help with this is appreciated.
> - Venkat.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message