sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xu, Qian A" <qian.a...@intel.com>
Subject RE: Sqoop free form query import with invalid dates
Date Thu, 25 Dec 2014 06:13:33 GMT
Hi Joanne,

If you can query data from specified table with datetime fields translated, you can use `--query
[QUERY]` instead of `--table [TABLE]`.

--Stanley (Qian) Xu

From: Joanne Chan [mailto:jchan@shutterstock.com]
Sent: Thursday, December 18, 2014 1:13 PM
To: user@sqoop.apache.org
Subject: Sqoop free form query import with invalid dates

I've noticed that invalid dates is causing the entire import to fail when trying to change
an existing sqoop import to free form query import.

There's no issues on the same data set when not using free form query.

Is this a known issue?  Is there any workaround?

The error:
14/12/18 00:11:33 INFO mapred.JobClient: Task Id : attempt_201412171757_0484_m_000000_1, Status
java.io.IOException: SQLException in nextKeyValue
        at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:266)
        at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:483)
        at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76)
        at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.sql

Thanks in advance!


View raw message