sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Martin, Nick" <NiMar...@pssd.com>
Subject RE: Sqoop from/to Oracle
Date Mon, 30 Sep 2013 22:58:31 GMT
Hi Abe, thanks for having a look I really appreciate it...

Version is 1.4.3.1.3.2.0-111


Command:

sqoop export --connect jdbc:oracle:thin:@xxx-scan.main.xxx.com:1521/xxxxx --table SOME_SCHEMA.SOME_TABLE
--export-dir /user/directory/subdirectory/tabledirectory --username xyz --password xyz


Error portion (replaced schema_table name with SCHEMA_TABLE):

13/09/30 18:48:52 INFO mapred.JobClient: Running job: job_201309301054_0021
13/09/30 18:48:53 INFO mapred.JobClient:  map 0% reduce 0%
13/09/30 18:49:00 INFO mapred.JobClient: Task Id : attempt_201309301054_0021_m_000001_0, Status
: FAILED
java.io.IOException: Can't export data, please check task tracker logs
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:185)
        at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
        at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
        ... 10 more

13/09/30 18:49:01 INFO mapred.JobClient: Task Id : attempt_201309301054_0021_m_000003_0, Status
: FAILED
java.io.IOException: Can't export data, please check task tracker logs
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:185)
        at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
        at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
        ... 10 more

13/09/30 18:49:06 INFO mapred.JobClient: Task Id : attempt_201309301054_0021_m_000001_1, Status
: FAILED
java.io.IOException: Can't export data, please check task tracker logs
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:185)
        at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
        at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
        ... 10 more

13/09/30 18:49:07 INFO mapred.JobClient: Task Id : attempt_201309301054_0021_m_000003_1, Status
: FAILED
java.io.IOException: Can't export data, please check task tracker logs
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:185)
        at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
        at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
        ... 10 more

13/09/30 18:49:10 INFO mapred.JobClient: Task Id : attempt_201309301054_0021_m_000002_0, Status
: FAILED
java.io.IOException: Can't export data, please check task tracker logs
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:185)
        at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
        at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
        ... 10 more

13/09/30 18:49:10 INFO mapred.JobClient: Task Id : attempt_201309301054_0021_m_000001_2, Status
: FAILED
java.io.IOException: Can't export data, please check task tracker logs
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
        at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:763)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:363)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
        at org.apache.hadoop.mapred.Child.main(Child.java:249)
Caused by: java.lang.IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]
        at java.sql.Timestamp.valueOf(Timestamp.java:185)
        at SCHEMA_TABLE.__loadFromFields(SCHEMA_TABLE.java:2027)
        at SCHEMA_TABLE.parse(SCHEMA_TABLE.java:1964)
        at org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:83)
        ... 10 more

13/09/30 18:49:17 INFO mapred.JobClient: Job complete: job_201309301054_0021
13/09/30 18:49:17 INFO mapred.JobClient: Counters: 8
13/09/30 18:49:17 INFO mapred.JobClient:   Job Counters
13/09/30 18:49:17 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=71819
13/09/30 18:49:17 INFO mapred.JobClient:     Total time spent by all reduces waiting after
reserving slots (ms)=0
13/09/30 18:49:17 INFO mapred.JobClient:     Total time spent by all maps waiting after reserving
slots (ms)=0
13/09/30 18:49:17 INFO mapred.JobClient:     Rack-local map tasks=5
13/09/30 18:49:17 INFO mapred.JobClient:     Launched map tasks=10
13/09/30 18:49:17 INFO mapred.JobClient:     Data-local map tasks=2
13/09/30 18:49:17 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
13/09/30 18:49:17 INFO mapred.JobClient:     Failed map tasks=1
13/09/30 18:49:17 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 26.2385 seconds (0
bytes/sec)
13/09/30 18:49:17 INFO mapreduce.ExportJobBase: Exported 0 records.
13/09/30 18:49:17 ERROR tool.ExportTool: Error during export: Export job failed!


From: Abraham Elmahrek [mailto:abe@cloudera.com]
Sent: Monday, September 30, 2013 6:36 PM
To: user@sqoop.apache.org
Subject: Re: Sqoop from/to Oracle

Nick,

What is the exact command you are using and the exact error you are seeing? Also, what version
of sqoop are you using?

-Abe

On Mon, Sep 30, 2013 at 3:32 PM, Martin, Nick <NiMartin@pssd.com<mailto:NiMartin@pssd.com>>
wrote:
Hi all,

I have a table I've imported from Oracle into HDFS and now I want to export it into an Oracle
Db (import and export table schemas are identical).

My initial attempt at exporting from HDFS (using Sqoop) to Oracle failed (data types failures).
So, my question is what's the best way for me to accomplish this? My source table is a mixture
of NUMBER, VARCHAR, DATE fields. Am I better off importing into a Hive table I define and
then exporting into Oracle from there? Or do I just need to do some export formatting in my
Sqoop export statement?

Any other intel you'd need to make a recommendation?

Thanks in advance,
Nick

Sent from my iPhone


Mime
View raw message