sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lovely kasi <kasilov...@gmail.com>
Subject Problem with sqoop merge
Date Sat, 16 Nov 2013 06:19:34 GMT
Hi,

i am trying to merge two imported tables in sqoop.

1. The first table has about 50 columns.In which some of them are of Date
type in DB,but when imported the sqoop is importing them as TimeStamp
datatype. THe columns .with timestamp datatype have NULL values in db. I
made sure to use the option "--null-string '\\N'" ,so that they come as
null and checked it also.

2.The second table is the same as first table but with incremental
import.The date column used to check for in the case of incremental import
doesnt have any null values.

But when i try to merge i get the following error

java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd
hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:203)
        at QueryResult.__loadFromFields(QueryResult.java:1587)
        at QueryResult.parse(QueryResult.java:1494)
        at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
        at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:681)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:347)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:416)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.Child.main(Child.java:264

Thanks,
Lovely

Mime
View raw message