sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Zhu Wayne <zhuw.chic...@gmail.com>
Subject sqoop merge exception
Date Mon, 09 Sep 2013 19:46:53 GMT
Version:  1.4.3-cdh4.3.0

I use sqoop import to load initial full snapshot and daily incremental data
and then merge them with sqoop merge to get daily snapshot.  Merge works
fine for 12 of 17 tables. And I got the following for the rest:
*13/09/09 10:59:50 INFO mapred.JobClient: Task Id :
attempt_201308211622_0171_m_000033_0, Status : FAILED
java.util.NoSuchElementException
        at java.util.AbstractList$Itr.next(AbstractList.java:350)
        at ORDERITEMS.__loadFromFields(ORDERITEMS.java:1916)
        at ORDERITEMS.parse(ORDERITEMS.java:1735)
        at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:53)
        at
org.apache.sqoop.mapreduce.MergeTextMapper.map(MergeTextMapper.java:34)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:140)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
        at org.apache.hadoop.mapred.Child.main(Child.java:262)
*
Is this a bug for merge tool? It seems to be data related since not all
table merges fail. All data are imported by sqoop import tool. Thanks.

Mime
View raw message