sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From YouPeng Yang <yypvsxf19870...@gmail.com>
Subject Re: Import job failed by chance
Date Tue, 28 May 2013 06:58:30 GMT
Hi sir

  I am sorry I did not gather the detail error logs.
  It seems to do somthing with YARN,when YARN allocates the resource in my
cluster node.After the YARN allocates the memory for the sqoop job
successfully, the job will succeed finally .
  However I find some nodes are busy ,and  the job  assigned on that nodes
 will failed after it wait for resource allocation.
  And the attached container on which the job will run syslog shows the
waitting .


Maybe I'm wrong ,please light me


container syslog:

2013-05-24 10:00:10,222 INFO [uber-SubtaskRunner]
org.apache.hadoop.mapred.LocalContainerLauncher: Processing the event
EventType: CONTAINER_REMOTE_LAUNCH for container
container_1369298403742_0153_01_000001 taskAttempt
attempt_1369298403742_0153_m_000000_0
2013-05-24 10:00:10,223 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: TaskAttempt:
[attempt_1369298403742_0153_m_000000_0] using containerId:
[container_1369298403742_0153_01_000001 on NM: [wxossetl1:46256]
2013-05-24 10:00:10,223 INFO [uber-SubtaskRunner]
org.apache.hadoop.mapred.LocalContainerLauncher:
mapreduce.cluster.local.dir for uber task:
/tmp/nm-local-dir/usercache/hadoop/appcache/application_1369298403742_0153
2013-05-24 10:00:10,225 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl:
attempt_1369298403742_0153_m_000000_0 TaskAttempt Transitioned from
ASSIGNED to RUNNING
2013-05-24 10:00:10,226 INFO [AsyncDispatcher event handler]
org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl:
task_1369298403742_0153_m_000000 Task Transitioned from SCHEDULED to RUNNING
2013-05-24 10:00:10,237 INFO [uber-SubtaskRunner]
org.apache.hadoop.mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.yarn.util.LinuxResourceCalculatorPlugin@34e77781
2013-05-24 10:00:13,224 INFO [communication thread]
org.apache.hadoop.mapred.TaskAttemptListenerImpl:
Ping from attempt_1369298403742_0153_m_000000_0
2013-05-24 10:00:16,225 INFO [communication thread]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from
attempt_1369298403742_0153_m_000000_0
2013-05-24 10:00:19,225 INFO [communication thread]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from
attempt_1369298403742_0153_m_000000_0



2013/5/27 Jarek Jarcec Cecho <jarcec@apache.org>

> Hi sir,
> It's hard to guess what is happening in your environment. It would be
> helpful if you could share logs (Sqoop log with parameter --verbose and map
> task log) of the failed job in order to investigate the issue.
>
> Jarcec
>
> On Thu, May 23, 2013 at 08:02:11PM +0800, yypvsxf19870706 wrote:
> > Hi users
> >
> >     It is weird that my import job failed sometimes . Then I have to
> start the import job manually , and it succeed again.
> >
> >     Is there anyways to ensure my import job successfully ?
> >
> >     I'm using sqoop-1.4
> >
> >
> > Regards
> >
> >
> >
> >
> >
> > 发自我的 iPhone
>

Mime
View raw message