sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kallinteris, Christos" <kallinte...@initions.com>
Subject AW: Data export to SQL Server fails with MAPRED_EXEC_0017:Error occurs during extractor run
Date Mon, 16 Sep 2013 09:56:25 GMT
Hello Jarcec,

thank you very much for your time and effort!

I used the Hue UI to recreate the scenario, since I had lost the logs from the last run, and
this time it worked. I can't honestly tell you what else I did differently but I can move
on with testing and evaluating now.

Thank you again!

Christos

--

initions AG
Christos Kallinteris
Weidestraße 120a
D-22083 Hamburg

t:   +49 (0) 40 / 41 49 60-79
f:   +49 (0) 40 / 41 49 60-11
e:  kallinteris@initions.com
w: www.initions.com
 

Vollständiger Name der Gesellschaft: initions innovative IT solutions AG
Sitz der Gesellschaft: Hamburg
Handelsregister Hamburg B 83929
Aufsichtsratsvorsitzender: Dr. Michael Leue
Vorstand: Dr. Stefan Anschütz, André Paul Henkel, Dr. Helge Plehn

-----Ursprüngliche Nachricht-----
Von: Jarek Jarcec Cecho [mailto:jarcec@apache.org] 
Gesendet: Montag, 16. September 2013 10:06
An: user@sqoop.apache.org
Betreff: Re: Data export to SQL Server fails with MAPRED_EXEC_0017:Error occurs during extractor
run

Hi Christos,
yes I mean the logs that can be retrieved from JobTracker. On the main webpage, you need to
get into job details and then find one failed task. We need entire log not just the exception.

Jarcec

On Thu, Sep 12, 2013 at 07:48:07AM +0000, Kallinteris, Christos wrote:
> Hello Jarcec,
> 
> I'm not sure which logs you require.
> 
> Do you mean the ones accessed through http://server:50030/jobdetails.jsp ?
> 
> This is what I get there. If you need a different log please let me know how and where
to access it.
> 
> Thank you!
> 
> Christos
> 
> ------------------BEGIN LOG--------------------
> 
> org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write to the
data writer
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> 	at org.apache.sqoop.job.etl.HdfsExportExtract
> org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write to the
data writer
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> 	at org.apache.sqoop.job.etl.HdfsExportExtract
> org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write to the
data writer
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> 	at org.apache.sqoop.job.etl.HdfsExportExtract
> org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> 	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write to the
data writer
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> 	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> 	at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> 	at org.apache.sqoop.job.etl.HdfsExportExtract
> 
> --------------------------------------------------END LOG 
> ---------------------------------
> 
> --
> 
> initions AG
> Christos Kallinteris
> Weidestraße 120a
> D-22083 Hamburg
> 
> t:   +49 (0) 40 / 41 49 60-79
> f:   +49 (0) 40 / 41 49 60-11
> e:  kallinteris@initions.com
> w: www.initions.com
>  
> 
> Vollständiger Name der Gesellschaft: initions innovative IT solutions 
> AG Sitz der Gesellschaft: Hamburg Handelsregister Hamburg B 83929
> Aufsichtsratsvorsitzender: Dr. Michael Leue
> Vorstand: Dr. Stefan Anschütz, André Paul Henkel, Dr. Helge Plehn
> 
> -----Ursprüngliche Nachricht-----
> Von: Jarek Jarcec Cecho [mailto:jarcec@apache.org]
> Gesendet: Donnerstag, 12. September 2013 08:38
> An: user@sqoop.apache.org
> Betreff: Re: Data export to SQL Server fails with 
> MAPRED_EXEC_0017:Error occurs during extractor run
> 
> Hi Christos,
> would you mind sharing with us map task log from the failed job?
> 
> Jarcec
> 
> On Mon, Sep 09, 2013 at 12:39:34PM +0000, Kallinteris, Christos wrote:
> > 
> > Hello all!
> > 
> > I have installed the latest CDH + Manager version from Cloudera on a freshly installed
Ubuntu 12.04 virtual host.
> > 
> > I have successfully imported a table from SQL Server into HDFS text files.
> > 
> > When I try to export it again to a new table with the exact same schema as the original
I get the following error in the logs:
> > 
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
> >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
> >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
> >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs during extractor
run
> >         at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
> >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:672)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:330)
> >         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:396)
> >         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
> >         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> > Caused by: org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0013:Cannot write
to the data writer
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
> >         at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeCsvRecord(SqoopMapper.java:133)
> >         at org.apache.sqoop.job.etl.HdfsExportExtractor.extractTextFile(HdfsExportExtractor.java:176)
> >         at org.apache.sqoop.job.etl.HdfsExportExtract
> > 
> > 
> > Any help or ideas will be greatly appreciated!
> > 
> > Thanks!
> > 
> > Christos
> > 
> > --
> > 
> > initions AG
> > Christos Kallinteris
> > Weidestraße 120a
> > D-22083 Hamburg
> > 
> > t:   +49 (0) 40 / 41 49 60-79
> > f:   +49 (0) 40 / 41 49 60-11
> > e:  kallinteris@initions.com<mailto:kallinteris@initions.com>
> > w: www.initions.com<http://www.initions.com/>
> > 
> > 
> > Vollständiger Name der Gesellschaft: initions innovative IT 
> > solutions AG Sitz der Gesellschaft: Hamburg Handelsregister Hamburg 
> > B 83929
> > Aufsichtsratsvorsitzender: Dr. Michael Leue
> > Vorstand: Dr. Stefan Anschütz, André Paul Henkel, Dr. Helge Plehn
> > 

Mime
View raw message