nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrzej Bialecki (JIRA)" <j...@apache.org>
Subject [jira] Commented: (NUTCH-581) DistributedSearch does not update search servers added to search-servers.txt on the fly
Date Mon, 03 Dec 2007 23:29:43 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12548045
] 

Andrzej Bialecki  commented on NUTCH-581:
-----------------------------------------

+1 as the first step ...

I think we should extend this support to include on-the-fly update in other scenarios (e.g.
detecting updated indexes on search servers, requesting reload of backends from the frontend,
etc).

Solr implements a good model for searcher reload. When an IndexSearcher needs to be reloaded,
Solr prepares a new searcher in the background and warms it up by running the topN queries,
and only when the new searcher is "warm" then it atomically switches the searchers, and closes
the old one. IMHO we should eventually implement a model like this.

> DistributedSearch does not update search servers added to search-servers.txt on the fly
> ---------------------------------------------------------------------------------------
>
>                 Key: NUTCH-581
>                 URL: https://issues.apache.org/jira/browse/NUTCH-581
>             Project: Nutch
>          Issue Type: Improvement
>          Components: searcher
>    Affects Versions: 0.9.0
>            Reporter: Rohan Mehta
>            Priority: Minor
>             Fix For: 0.9.0
>
>         Attachments: UpdateSearch.patch
>
>
> DistributedSearch client updates the search servers added to the search-servers.txt file
on the fly. 
> This patch will updates the search servers on the fly and the client does not need a
restart.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message