sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kathleen Ting <kathl...@apache.org>
Subject Re: Oraoop_Issue
Date Fri, 14 Mar 2014 07:19:39 GMT
Again, moving to user@sqoop.apache.org (please subscribe if you
haven't already, Kartheek).

Kartheek, is this from attempt_201403100147_0004_m_000001_1 or one of
the failed task logs?

On Thu, Mar 13, 2014 at 9:27 PM, kartheek reddy
<kartheek.srmuni@outlook.com> wrote:

> i found this error in task tracker log.
> 2014-03-13 21:17:16,809 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-669109447 given task:
> attempt_201403132057_0001_m_000001_1
> 2014-03-13 21:17:18,483 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000000_1 0.0%
> 2014-03-13 21:17:18,517 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000001_1 0.0%
> 2014-03-13 21:17:18,687 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-1511417430 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:18,711 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-669109447 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:21,690 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:21,713 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 2
> 2014-03-13 21:17:21,856 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000000_2 task's
> state:UNASSIGNED
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000001_2 task's
> state:UNASSIGNED
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000000_2 which needs 1 slots
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 2 and trying to launch
> attempt_201403132057_0001_m_000000_2 which needs 1 slots
> 2014-03-13 21:17:21,857 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000001_2 which needs 1 slots
> 2014-03-13 21:17:21,858 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 1 and trying to launch
> attempt_201403132057_0001_m_000001_2 which needs 1 slots
> 2014-03-13 21:17:21,867 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_107561801
> 2014-03-13 21:17:21,867 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_107561801 spawned.
> 2014-03-13 21:17:21,868 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-238632827
> 2014-03-13 21:17:21,872 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_-238632827 spawned.
> 2014-03-13 21:17:21,873 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000000_2/taskjvm.sh
> 2014-03-13 21:17:21,874 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000001_2/taskjvm.sh
> 2014-03-13 21:17:22,524 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-238632827 given task:
> attempt_201403132057_0001_m_000001_2
> 2014-03-13 21:17:22,573 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_107561801 given task:
> attempt_201403132057_0001_m_000000_2
> 2014-03-13 21:17:24,327 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000000_2 0.0%
> 2014-03-13 21:17:24,473 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000001_2 0.0%
> 2014-03-13 21:17:24,621 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_107561801 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:24,636 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-238632827 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:27,627 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:27,642 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 2
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000000_3 task's
> state:UNASSIGNED
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000001_3 task's
> state:UNASSIGNED
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000000_3 which needs 1 slots
> 2014-03-13 21:17:27,675 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 2 and trying to launch
> attempt_201403132057_0001_m_000000_3 which needs 1 slots
> 2014-03-13 21:17:27,676 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000001_3 which needs 1 slots
> 2014-03-13 21:17:27,676 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 1 and trying to launch
> attempt_201403132057_0001_m_000001_3 which needs 1 slots
> 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-607582511
> 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_-607582511 spawned.
> 2014-03-13 21:17:27,685 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_1970579140
> 2014-03-13 21:17:27,694 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_1970579140 spawned.
> 2014-03-13 21:17:27,694 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000000_3/taskjvm.sh
> 2014-03-13 21:17:27,696 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000001_3/taskjvm.sh
> 2014-03-13 21:17:28,389 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-607582511 given task:
> attempt_201403132057_0001_m_000000_3
> 2014-03-13 21:17:28,434 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_1970579140 given task:
> attempt_201403132057_0001_m_000001_3
> 2014-03-13 21:17:30,045 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000000_3 0.0%
> 2014-03-13 21:17:30,117 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000001_3 0.0%
> 2014-03-13 21:17:30,162 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-607582511 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:30,267 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_1970579140 exited with exit code 0. Number of tasks
> it ran: 0
> 2014-03-13 21:17:33,163 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker:
> LaunchTaskAction (registerTask): attempt_201403132057_0001_m_000004_0 task's
> state:UNASSIGNED
> 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker: Trying to
> launch : attempt_201403132057_0001_m_000004_0 which needs 1 slots
> 2014-03-13 21:17:33,171 INFO org.apache.hadoop.mapred.TaskTracker: In
> TaskLauncher, current free slots : 1 and trying to launch
> attempt_201403132057_0001_m_000004_0 which needs 1 slots
> 2014-03-13 21:17:33,176 INFO org.apache.hadoop.mapred.JvmManager: In
> JvmRunner constructed JVM ID: jvm_201403132057_0001_m_-1874753763
> 2014-03-13 21:17:33,177 INFO org.apache.hadoop.mapred.JvmManager: JVM Runner
> jvm_201403132057_0001_m_-1874753763 spawned.
> 2014-03-13 21:17:33,178 INFO org.apache.hadoop.mapred.TaskController:
> Writing commands to
> /home/hduser/tmp/mapred/local/ttprivate/taskTracker/hduser/jobcache/job_201403132057_0001/attempt_201403132057_0001_m_000004_0/taskjvm.sh
> 2014-03-13 21:17:33,268 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 1
> 2014-03-13 21:17:33,818 INFO org.apache.hadoop.mapred.TaskTracker: JVM with
> ID: jvm_201403132057_0001_m_-1874753763 given task:
> attempt_201403132057_0001_m_000004_0
> 2014-03-13 21:17:34,619 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000004_0 0.0%
> 2014-03-13 21:17:34,669 INFO org.apache.hadoop.mapred.TaskTracker:
> attempt_201403132057_0001_m_000004_0 0.0% cleanup
> 2014-03-13 21:17:34,670 INFO org.apache.hadoop.mapred.TaskTracker: Task
> attempt_201403132057_0001_m_000004_0 is done.
> 2014-03-13 21:17:34,671 INFO org.apache.hadoop.mapred.TaskTracker: reported
> output size for attempt_201403132057_0001_m_000004_0  was -1
> 2014-03-13 21:17:34,671 INFO org.apache.hadoop.mapred.TaskTracker:
> addFreeSlot : current free slots : 2
> 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received
> KillTaskAction for task: attempt_201403132057_0001_m_000000_3
> 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received
> KillTaskAction for task: attempt_201403132057_0001_m_000001_3
> 2014-03-13 21:17:34,812 INFO org.apache.hadoop.mapred.TaskTracker: Received
> 'KillJobAction' for job: job_201403132057_0001
> 2014-03-13 21:17:34,814 INFO org.apache.hadoop.mapred.IndexCache: Map ID
> attempt_201403132057_0001_m_000004_0 not found in cache
> 2014-03-13 21:17:34,814 INFO org.apache.hadoop.mapred.UserLogCleaner: Adding
> job_201403132057_0001 for user-log deletion with
> retainTimeStamp:1394857054814
> 2014-03-13 21:17:34,870 INFO org.apache.hadoop.mapred.JvmManager: JVM :
> jvm_201403132057_0001_m_-1874753763 exited with exit code 0. Number of tasks
> it ran: 1
>
>
> Thanks & Regards
> Kartheek Reddy
> 91-8390753543
>
>
>> From: kathleen@apache.org
>> Date: Thu, 13 Mar 2014 15:02:27 -0700
>> Subject: Re: Oraoop_Issue
>> To: kartheek.srmuni@outlook.com; user@sqoop.apache.org
>
>>
>> Moving to user@sqoop.apache.org (please subscribe if you haven't
>> already, Kartheek).
>>
>> Hi Kartheek,
>>
>> As mentioned in the error message "Can't export data, please check
>> task tracker logs," looks like there will be more helpful debugging
>> information contained in attempt_201403100147_0004_m_000001_1 - can
>> you please post the error messages from there?
>>
>> Regards,
>> Kate
>>
>> On Wed, Mar 12, 2014 at 10:22 PM, kartheek reddy
>> <kartheek.srmuni@outlook.com> wrote:
>> >
>> > Hi Kathleen ,
>> >
>> > Greeting.
>> >
>> > This is Kartheek from india. i had
>> > issue withe oraoop connector.while am exporting the data from hive to
>> > oracle
>> > database am getting follow error ...please can u help me on this.i
>> > posted
>> > but no body reply me.and one more query like how can i increase my
>> > export/import performance by using oraoop. if any parameters i have to
>> > change in oraoop-site.xml.if changes required please tell me what are
>> > the
>> > changes i do.. here am using sqoop version is apache sqopp 1.4.3 and
>> > hadoop
>> > 1.1.2 .
>> >
>> > 14/03/10 02:21:46 INFO mapred.JobClient: Task Id :
>> > attempt_201403100147_0004_m_000001_1, Status : FAILED
>> > java.io.IOException: Can't export data, please check task tracker logs
>> > at
>> >
>> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:112)
>> > at
>> >
>> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:39)
>> > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> > at
>> >
>> > org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
>> > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
>> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
>> > at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
>> > at java.security.AccessController.doPrivileged(Native Method)
>> > at javax.security.auth.Subject.doAs(Subject.java:415)
>> > at
>> >
>> > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
>> > at org.apache.hadoop.mapred.Child.main(Child.java:249)
>> > Caused by: java.io.IOException: java.sql.SQLException:
>> > java.lang.NullPointerException
>> > at
>> >
>> > org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:220)
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:507)
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.write(OraOopOutputFormatInsert.java:94)
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatBase$OraOopDBRecordWriterBase.write(OraOopOutputFormatBase.java:175)
>> > at
>> >
>> > org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:639)
>> > at
>> >
>> > org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
>> > at
>> >
>> > org.apache.sqoop.mapreduce.TextExportMapper.map(TextExportMapper.java:84)
>> > ... 10 more
>> > Caused by: java.sql.SQLException: java.lang.NullPointerException
>> > at
>> >
>> > com.quest.oraoop.OraOopOutputFormatInsert$OraOopDBRecordWriterInsert.configurePreparedStatement(OraOopOutputFormatInsert.java:228)
>> > sqoop export --connect jdbc:oracle:thin:@servername:1521:grasa01
>> > --username
>> > TEST --password gra --table K --export-dir /user/hive/warehouse/k
>> > --columns
>> > 'c_id' --input-lines-terminated-by '\n'
>> >
>> >
>> > Thanks & Regards
>> > Kartheek Reddy

Mime
View raw message