nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrzej Bialecki (JIRA)" <>
Subject [jira] Commented: (NUTCH-770) Timebomb for Fetcher
Date Mon, 30 Nov 2009 12:59:22 GMT


Andrzej Bialecki  commented on NUTCH-770:

bq.   "time limit" is definitely better than timebomb (but not as amusing). 

:) let's got for "informative" and "less confusing" now ... Could you please also add the
nutch-default.xml property and its documentation.

Re: FetchQueues - ok, you have a point here.

Re: code style - yes.

> Timebomb for Fetcher
> --------------------
>                 Key: NUTCH-770
>                 URL:
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Julien Nioche
>         Attachments: log-770, NUTCH-770.patch
> This patch provides the Fetcher with a timebomb mechanism. By default the timebomb is
not activated; it can be set using the parameter fetcher.timebomb.mins. The number of minutes
is relative to the start of the Fetch job. When the number of minutes is reached, the QueueFeeder
skips all remaining entries then all active queues are purged. This allows to keep the Fetch
step under comtrol and works well in combination with NUTCH-769

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message