nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From joel gump <biglaugh...@gmail.com>
Subject Re: Plugins: when to perform web service requests, on fetch or on index?
Date Thu, 18 Jun 2009 15:49:21 GMT
If only the urls is used, how about save urls to a database.
Then, another app check the database, call webservices.
Personally , i dont like mix something with crawl/index process.

On Thu, Jun 18, 2009 at 10:28 PM, caezar<caezaris@gmail.com> wrote:
>
> I don't think it will be faster: crawling is performed on cluster.
>
> joel gump wrote:
>>
>> how about write standalone app. analyze data after crawl and index.
>>
>>
>
> --
> View this message in context: http://www.nabble.com/Plugins%3A-when-to-perform-web-service-requests%2C-on-fetch-or-on-index--tp24089858p24092992.html
> Sent from the Nutch - Dev mailing list archive at Nabble.com.
>
>

Mime
View raw message