sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yash Ranadive <yash.ranad...@lookout.com>
Subject Re: Timestamp not supported in sqoop2
Date Tue, 22 Oct 2013 19:17:34 GMT
I see the following error in the MapReduce logs when trying to execute a
sqoop2 job that gets data from a mysql table with a timestamp column. A
table with no timestamps gets loaded fine.

Does sqoop2 not support timestamp columns? Sounds counterintuitive.



2013-10-22 12:03:02,570 FATAL [IPC Server handler 2 on 42160]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1381794869316_1175_m_000000_0 - exited :
org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs
during extractor run
	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:756)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:338)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
Caused by: org.apache.sqoop.common.SqoopException:
MAPRED_EXEC_0013:Cannot write to the data writer
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeArrayRecord(SqoopMapper.java:128)
	at org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:61)
	at org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:31)
	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:93)
	... 7 more
Caused by: java.io.IOException:
org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0012:The type is
not supported - java.sql.Timestamp
	at org.apache.sqoop.job.io.Data.writeArray(Data.java:309)
	at org.apache.sqoop.job.io.Data.write(Data.java:171)
	at org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:100)
	at org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:84)
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1112)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:685)
	at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
	at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:144)
	... 11 more
Caused by: org.apache.sqoop.common.SqoopException:
MAPRED_EXEC_0012:The type is not supported - java.sql.Timestamp
	... 20 more

2013-10-22 12:03:02,570 INFO [IPC Server handler 2 on 42160]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report
from attempt_1381794869316_1175_m_000000_0: Error:
org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs
during extractor run
	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:756)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:338)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
Caused by: org.apache.sqoop.common.SqoopException:
MAPRED_EXEC_0013:Cannot write to the data writer
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeArrayRecord(SqoopMapper.java:128)
	at org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:61)
	at org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:31)
	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:93)
	... 7 more
Caused by: java.io.IOException:
org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0012:The type is
not supported - java.sql.Timestamp
	at org.apache.sqoop.job.io.Data.writeArray(Data.java:309)
	at org.apache.sqoop.job.io.Data.write(Data.java:171)
	at org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:100)
	at org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:84)
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1112)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:685)
	at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
	at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:144)
	... 11 more
Caused by: org.apache.sqoop.common.SqoopException:
MAPRED_EXEC_0012:The type is not supported - java.sql.Timestamp
	... 20 more

2013-10-22 12:03:02,572 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
Diagnostics report from attempt_1381794869316_1175_m_000000_0: Error:
org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0017:Error occurs
during extractor run
	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:98)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:756)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:338)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:157)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:152)
Caused by: org.apache.sqoop.common.SqoopException:
MAPRED_EXEC_0013:Cannot write to the data writer
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:146)
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeArrayRecord(SqoopMapper.java:128)
	at org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:61)
	at org.apache.sqoop.connector.jdbc.GenericJdbcImportExtractor.extract(GenericJdbcImportExtractor.java:31)
	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:93)
	... 7 more
Caused by: java.io.IOException:
org.apache.sqoop.common.SqoopException: MAPRED_EXEC_0012:The type is
not supported - java.sql.Timestamp
	at org.apache.sqoop.job.io.Data.writeArray(Data.java:309)
	at org.apache.sqoop.job.io.Data.write(Data.java:171)
	at org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:100)
	at org.apache.hadoop.io.serializer.WritableSerialization$WritableSerializer.serialize(WritableSerialization.java:84)
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:1112)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:685)
	at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
	at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
	at org.apache.sqoop.job.mr.SqoopMapper$MapDataWriter.writeContent(SqoopMapper.java:144)
	... 11 more
Caused by: org.apache.sqoop.common.SqoopException:
MAPRED_EXEC_0012:The type is not supported - java.sql.Timestamp
	... 20 more

2013-10-22 12:03:02,573 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1381794869316_1175_m_000000_0 TaskAttempt Transitioned from
RUNNING to FAIL_CONTAINER_CLEANUP

Mime
View raw message