nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vladimir Loubenski <vloub...@opentext.com>
Subject Nutch 2.3.1: REST API calls stop and abort failed to stop running jobs
Date Tue, 07 Feb 2017 19:54:12 GMT
Hi there,
I have installed Nutch 2.3.1 .

During running Fetch or Parse Nutch job I call REST API abort (GET /job/job-id-5977/abort)
or stop (GET /job/job-id-5977/stop) to Nutch server.

I can see in debugger that the call end up in Hadoop call   currentJob.killJob() in both cases.

The job continue to run and in hadoop log file I see: INFO  mapreduce.Job - Job job_local827431513_0001
failed with state KILLED due to: NA .

The abort and stop calls failed to stop the Nutch job.

After with  GET /job/job-id-5977  I receive

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

  "result" : null,

  "state" : "FAILED",

  "msg" : "ERROR: java.lang.RuntimeException: job failed: name=[crawl-00]fetch, jobid=job_local367443839_0005",

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>

Is it Nutch 2.3.1 bug?

Regards,
Vladimir.
Mime
View raw message