sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-1453) Sqoop2: Suport export of null from hdfs text files to RDBMS numeric columns
Date Tue, 19 Aug 2014 23:31:18 GMT
Gwen Shapira created SQOOP-1453:
-----------------------------------

             Summary: Sqoop2: Suport export of null from hdfs text files to RDBMS numeric
columns
                 Key: SQOOP-1453
                 URL: https://issues.apache.org/jira/browse/SQOOP-1453
             Project: Sqoop
          Issue Type: Bug
          Components: sqoop2-framework
            Reporter: Gwen Shapira


Suppose you have an RDBMS table with number column containing nulls.

When you Sqoop the data to HDFS text file, you get:
,null,

When you try to Sqoop this file back to RDBMS, you get:
2014-08-19 15:12:42,552 [OutputFormatLoader-consumer] ERROR org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor
 - Error while loading data out of MR job.
java.lang.NumberFormatException
	at java.math.BigDecimal.<init>(BigDecimal.java:470)
	at java.math.BigDecimal.<init>(BigDecimal.java:739)
	at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.getObjectData(CSVIntermediateDataFormat.java:219)
	at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$OutputFormatDataReader.readArrayRecord(SqoopOutputFormatLoadExecutor.java:157)
	at org.apache.sqoop.connector.jdbc.GenericJdbcLoader.load(GenericJdbcLoader.java:48)
	at org.apache.sqoop.connector.jdbc.GenericJdbcLoader.load(GenericJdbcLoader.java:25)
	at org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor$ConsumerThread.run(SqoopOutputFormatLoadExecutor.java:248)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)

Because "null" doesn't convert to BigDecimal.

We need to detect handle these cases.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message