sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jarek Jarcec Cecho <jar...@apache.org>
Subject Re: Data export to SQL Server fails with MAPRED_EXEC_0017:Error occurs during extractor run
Date Mon, 16 Sep 2013 12:04:44 GMT
Glad to hear that, happy Sqooping!

Jarcec

On Mon, Sep 16, 2013 at 09:56:25AM +0000, Kallinteris, Christos wrote:
> Hello Jarcec,
> 
> thank you very much for your time and effort!
> 
> I used the Hue UI to recreate the scenario, since I had lost the logs from the last run,
and this time it worked. I can't honestly tell you what else I did differently but I can move
on with testing and evaluating now.
> 
> Thank you again!
> 
> Christos
> 
> --
> 
> initions AG
> Christos Kallinteris
> Weidestraße 120a
> D-22083 Hamburg
> 
> t:   +49 (0) 40 / 41 49 60-79
> f:   +49 (0) 40 / 41 49 60-11
> e:  kallinteris@initions.com
> w: www.initions.com
>  
> 
> Vollständiger Name der Gesellschaft: initions innovative IT solutions AG
> Sitz der Gesellschaft: Hamburg
> Handelsregister Hamburg B 83929
> Aufsichtsratsvorsitzender: Dr. Michael Leue
> Vorstand: Dr. Stefan Anschütz, André Paul Henkel, Dr. Helge Plehn
> 
> -----Ursprüngliche Nachricht-----
> Von: Jarek Jarcec Cecho [mailto:jarcec@apache.org] 
> Gesendet: Montag, 16. September 2013 10:06
> An: user@sqoop.apache.org
> Betreff: Re: Data export to SQL Server fails with MAPRED_EXEC_0017:Error occurs during
extractor run
> 
> Hi Christos,
> yes I mean the logs that can be retrieved from JobTracker. On the main webpage, you need
to get into job details and then find one failed task. We need entire log not just the exception.
> 
> Jarcec
> 
> On Thu, Sep 12, 2013 at 07:48:07AM +0000, Kallinteris, Christos wrote:
> > Hello Jarcec,
> > 
> > I'm not sure which logs you require.
> > 
> > Do you mean the ones accessed through http://server:50030/jobdetails.jsp ?
> > 
> > This is what I get there. If you need a different log please let me know how and
where to access it.
> > 
> > Thank you!
> > 
> > Christos
> > 
> > ------------------BEGIN LOG--------------------
> > 
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> > 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > 	at java.security.AccessController.doPrivileged(Native Method)
> > 	at javax.security.auth.Subject.doAs(Subject.java:396)
> > 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtract
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> > 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > 	at java.security.AccessController.doPrivileged(Native Method)
> > 	at javax.security.auth.Subject.doAs(Subject.java:396)
> > 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtract
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> > 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > 	at java.security.AccessController.doPrivileged(Native Method)
> > 	at javax.security.auth.Subject.doAs(Subject.java:396)
> > 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtract
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> > 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > 	at java.security.AccessController.doPrivileged(Native Method)
> > 	at javax.security.auth.Subject.doAs(Subject.java:396)
> > 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > 	at org.apache.sqoop.job.etl.HdfsExportExtract
> > 
> > --------------------------------------------------END LOG 
> > ---------------------------------
> > 
> > --
> > 
> > initions AG
> > Christos Kallinteris
> > Weidestraße 120a
> > D-22083 Hamburg
> > 
> > t:   +49 (0) 40 / 41 49 60-79
> > f:   +49 (0) 40 / 41 49 60-11
> > e:  kallinteris@initions.com
> > w: www.initions.com
> >  
> > 
> > Vollständiger Name der Gesellschaft: initions innovative IT solutions 
> > AG Sitz der Gesellschaft: Hamburg Handelsregister Hamburg B 83929
> > Aufsichtsratsvorsitzender: Dr. Michael Leue
> > Vorstand: Dr. Stefan Anschütz, André Paul Henkel, Dr. Helge Plehn
> > 
> > -----Ursprüngliche Nachricht-----
> > Von: Jarek Jarcec Cecho [mailto:jarcec@apache.org]
> > Gesendet: Donnerstag, 12. September 2013 08:38
> > An: user@sqoop.apache.org
> > Betreff: Re: Data export to SQL Server fails with 
> > MAPRED_EXEC_0017:Error occurs during extractor run
> > 
> > Hi Christos,
> > would you mind sharing with us map task log from the failed job?
> > 
> > Jarcec
> > 
> > On Mon, Sep 09, 2013 at 12:39:34PM +0000, Kallinteris, Christos wrote:
> > > 
> > > Hello all!
> > > 
> > > I have installed the latest CDH + Manager version from Cloudera on a freshly
installed Ubuntu 12.04 virtual host.
> > > 
> > > I have successfully imported a table from SQL Server into HDFS text files.
> > > 
> > > When I try to export it again to a new table with the exact same schema as
the original I get the following error in the logs:
> > > 
> > > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during
extractor run
> > >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > >         at java.security.AccessController.doPrivileged(Native Method)
> > >         at javax.security.auth.Subject.doAs(Subject.java:396)
> > >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot
write to the data writer
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during
extractor run
> > >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > >         at java.security.AccessController.doPrivileged(Native Method)
> > >         at javax.security.auth.Subject.doAs(Subject.java:396)
> > >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot
write to the data writer
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during
extractor run
> > >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > >         at java.security.AccessController.doPrivileged(Native Method)
> > >         at javax.security.auth.Subject.doAs(Subject.java:396)
> > >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot
write to the data writer
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during
extractor run
> > >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> > >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> > >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> > >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> > >         at java.security.AccessController.doPrivileged(Native Method)
> > >         at javax.security.auth.Subject.doAs(Subject.java:396)
> > >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> > >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot
write to the data writer
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> > >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> > >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > > 
> > > 
> > > Any help or ideas will be greatly appreciated!
> > > 
> > > Thanks!
> > > 
> > > Christos
> > > 
> > > --
> > > 
> > > initions AG
> > > Christos Kallinteris
> > > Weidestraße 120a
> > > D-22083 Hamburg
> > > 
> > > t:   +49 (0) 40 / 41 49 60-79
> > > f:   +49 (0) 40 / 41 49 60-11
> > > e:  kallinteris@initions.com<mailto:kallinteris@initions.com>
> > > w: www.initions.com<http://www.initions.com/>
> > > 
> > > 
> > > Vollständiger Name der Gesellschaft: initions innovative IT 
> > > solutions AG Sitz der Gesellschaft: Hamburg Handelsregister Hamburg 
> > > B 83929
> > > Aufsichtsratsvorsitzender: Dr. Michael Leue
> > > Vorstand: Dr. Stefan Anschütz, André Paul Henkel, Dr. Helge Plehn
> > > 

Mime
View raw message