nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sherjeel Niazi <>
Subject How to resume crawler after crash
Date Thu, 23 Apr 2009 15:02:42 GMT

I am using Nutch 0.9
I am crawling a series of URL's of a website but after some time the crawler
crash with the following error:

Exception in thread "main" Job failed!
    at org.apache.hadoop.mapred.JobClient.runJob(
    at org.apache.nutch.crawl.CrawlDb.update(
    at org.apache.nutch.crawl.CrawlDb.update(
    at org.apache.nutch.crawl.Crawl.main(

How can I resume the crawler where it ends?


View raw message