nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From caezar <caeza...@gmail.com>
Subject Re: Plugins: when to perform web service requests, on fetch or on index?
Date Thu, 18 Jun 2009 13:27:45 GMT

Hi,

Thank you for the response. Parsed data is not used in calls. Only page URL.
So performance will be better if perform this requests on parsing stage? 

Stefan Dlugolinsky wrote:
> 
> Hello,
> 
> I don't know how v 1.0 differs from v 0.9, but in v 0.9, I would do
> those service requests in the stage of indexation (extension point
> IndexingFilter), where you have several data prepared from previous
> stage (by parsers, etc.), so you can use this data in the requests.
> But it depends on what you exactly want, whether you want to use
> parsed data in the requests. If not, you can call webservice requests
> earlier from parsing stage (extension point Parse).
> 
> Here is something about core extension points:
> http://wiki.apache.org/nutch/AboutPlugins
> 
> Steve
> 
> 

-- 
View this message in context: http://www.nabble.com/Plugins%3A-when-to-perform-web-service-requests%2C-on-fetch-or-on-index--tp24089858p24092973.html
Sent from the Nutch - Dev mailing list archive at Nabble.com.


Mime
View raw message