sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thuy Nguyen <thngu...@gmail.com>
Subject Fwd: sqoop and --direct option
Date Tue, 02 Apr 2013 17:34:52 GMT
Hi all,

I got error exporting from hive to mysql (without --direct option) as below:

java.lang.NumberFormatException: For input string: "\N"
        at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
        at java.lang.Long.parseLong(Long.java:410)
        at java.lang.Long.valueOf(Long.java:525)
        at
hive_category_event_type_facts.__loadFromFields(hive_category_event_type_facts.java:314)
        at
hive_category_event_type_facts.parse(hive_category_event_type_facts.java:251)
        at
com.cloudera.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:81)
        at
com.cloudera.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:40)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at
com.cloudera.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:189)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.had

and by running swoop with --direct option, '\N' is converted to 0 and thus,
sqoop succeeded.

Could you please advise if --direct option is expected to have that side
effect?

Thanks,
Thuy

Mime
View raw message