sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2846) Sqoop Export with update-key failing for avro data file
Date Mon, 21 Mar 2016 18:34:25 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15204838#comment-15204838
] 

Hudson commented on SQOOP-2846:
-------------------------------

FAILURE: Integrated in Sqoop-hadoop100 #1008 (See [https://builds.apache.org/job/Sqoop-hadoop100/1008/])
SQOOP-2846: Sqoop Export with update-key failing for avro data file (jarcec: [https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=0c8b1054818d2aab0089499a46a8281b69b1bfd2])
* src/test/com/cloudera/sqoop/testutil/ExportJobTestCase.java
* src/test/com/cloudera/sqoop/TestParquetExport.java
* src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
* src/test/com/cloudera/sqoop/TestAvroExport.java


> Sqoop Export with update-key failing for avro data file
> -------------------------------------------------------
>
>                 Key: SQOOP-2846
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2846
>             Project: Sqoop
>          Issue Type: Bug
>          Components: connectors/oracle
>    Affects Versions: 1.4.6
>            Reporter: Abhinav Meghmala
>            Assignee: VISHNU S NAIR
>             Fix For: 1.4.7
>
>         Attachments: 0001-SQOOP-2846.patch
>
>
> Hi, I am trying to export an AVRO data file from HDFS to Oracle database (11gR2) using
an update-key in sqoop command Ex: 
> sqoop export \ 
> --connect jdbc:oracle:thin:@X.X.X.X:1521/xe \ 
> --username ***** \ 
> --password ***** \ 
> --table XXX \ 
> --update-key <primary-key-column-name> \ 
> --update-mode allowinsert \ 
> --export-dir <hdfs-path> 
> However, the same export is successful without using the "update-key" in sqoop command.

> Failure Logs - 
> Error: java.io.IOException: Can't export data, please check failed map task logs 
> at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112) 
> at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39) 
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) 
> at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64) 
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) 
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) 
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) 
> at java.security.AccessController.doPrivileged(Native Method) 
> at javax.security.auth.Subject.doAs(Subject.java:415) 
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)

> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) 
> Caused by: java.lang.RuntimeException: Can't parse input data: 'Objavro.schema�'

> at EMP.__loadFromFields(EMP.java:526) 
> at EMP.parse(EMP.java:439) 
> at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83) 
> ... 10 more 
> Caused by: java.lang.NumberFormatException 
> at java.math.BigDecimal.<init>(BigDecimal.java:470) 
> at java.math.BigDecimal.<init>(BigDecimal.java:739) 
> at EMP.__loadFromFields(EMP.java:488) 
> ... 12 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message