sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chaitanya Krishna Kande (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-3277) Sqoop from Oracle RDB database is failing with exception SQLException in nextKeyValue
Date Tue, 16 Jan 2018 19:57:00 GMT
Chaitanya Krishna Kande created SQOOP-3277:
----------------------------------------------

             Summary: Sqoop from Oracle RDB database is failing with exception SQLException
in nextKeyValue
                 Key: SQOOP-3277
                 URL: https://issues.apache.org/jira/browse/SQOOP-3277
             Project: Sqoop
          Issue Type: Bug
          Components: test
    Affects Versions: 1.4.6
         Environment: Production :

Sqoop from Oracle RDB database is failing with exception SQLException in nextKeyValue

Sqoop from Oracle RDB database is failing with exception SQLException in nextKeyValue. Below
is the error log

17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is deprecated. Instead,
use mapreduce.job.queuename
17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1512111796128_818880
17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized external token manager
class - com.mapr.hadoop.yarn.security.MapRTicketManager
17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application application_1512111796128_818880
17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job: https://dbsld0069.uhc.com:8090/proxy/application_1512111796128_818880/
17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880
17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running in uber mode :
false
17/12/22 11:20:43 INFO mapreduce.Job:  map 0% reduce 0%
17/12/22 15:13:18 INFO mapreduce.Job: Task Id : attempt_1512111796128_818880_m_000000_0, Status
: FAILED
Error: java.io.IOException: SQLException in nextKeyValue
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:565)
at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data channel
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1128)
at oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
... 12 more

Caused by: oracle.net.ns.NetException: End of TNS data channel
at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:260)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:185)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:102)
at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
... 15 more

 

 

--> Database from which we are sqooping data is Oracle RDB. We have tried out different
work arounds.

1. Mapping all the columns to String while sqooping
2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null while sqooping.

This work around successfully sqooped most of the tables but still we are facing the exception
for few tables.

Does any one came across this issue whie sqooping? Could you please provide any suggestions/help
on how to resolve this
            Reporter: Chaitanya Krishna Kande


Sqoop from Oracle RDB database is failing with exception SQLException in nextKeyValue. Below
is the error log

17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is deprecated. Instead,
use mapreduce.job.queuename
17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1512111796128_818880
17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized external token manager
class - com.mapr.hadoop.yarn.security.MapRTicketManager
17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application application_1512111796128_818880
17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job: https://dbsld0069.uhc.com:8090/proxy/application_1512111796128_818880/
17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880
17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running in uber mode :
false
17/12/22 11:20:43 INFO mapreduce.Job:  map 0% reduce 0%
17/12/22 15:13:18 INFO mapreduce.Job: Task Id : attempt_1512111796128_818880_m_000000_0, Status
: FAILED
Error: java.io.IOException: SQLException in nextKeyValue
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:565)
at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data channel
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1128)
at oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
... 12 more

Caused by: oracle.net.ns.NetException: End of TNS data channel
at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:260)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:185)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:102)
at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
... 15 more

 

 

--> Database from which we are sqooping data is Oracle RDB. We have tried out different
work arounds.

1. Mapping all the columns to String while sqooping
2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null while sqooping.

This work around successfully sqooped most of the tables but still we are facing the exception
for few tables.

Does any one came across this issue whie sqooping? Could you please provide any suggestions/help
on how to resolve this



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message