nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Asitang Mishra (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2015) Make FetchNodeDb optional (off by default) if NutchServer is not used
Date Wed, 27 May 2015 18:25:17 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14561434#comment-14561434
] 

Asitang Mishra commented on NUTCH-2015:
---------------------------------------

Hi [~chrismattmann],

I think [~sujenshah] is already on this task and might even have a patch ready, as it's a
small one. I am just waiting for him to update this (he will reach today). Let's hope he does
this withing a couple of days or else I will do it. Meanwhile I am working on the crawl API
and crawlDB API right now. 

> Make FetchNodeDb optional (off by default) if NutchServer is not used
> ---------------------------------------------------------------------
>
>                 Key: NUTCH-2015
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2015
>             Project: Nutch
>          Issue Type: Sub-task
>          Components: fetcher, REST_api
>            Reporter: Sujen Shah
>            Assignee: Chris A. Mattmann
>              Labels: memex
>             Fix For: 1.11
>
>
> Currently, the FetchNodes are created even if the NutchServer is not used causing memory
exceptions. This patch makes the fetcher report to the FetchNodeDb only if the crawl is invoked
from the REST service (ie NutchServer)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message