nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris A. Mattmann (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (NUTCH-2015) Make FetchNodeDb optional (off by default) if NutchServer is not used
Date Tue, 02 Jun 2015 04:30:18 GMT

     [ https://issues.apache.org/jira/browse/NUTCH-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chris A. Mattmann resolved NUTCH-2015.
--------------------------------------
    Resolution: Fixed

Committed, and formatted.

{noformat}
commit -m "- fix for NUTCH-2015 Make FetchNodeDb optional (off by default) if NutchServer
is not used contributed by Sujen Shah this closes #25" /Users/mattmann/src/nutch/src/java/org/apache/nutch/fetcher/FetcherThread.java
/Users/mattmann/src/nutch/CHANGES.txt
    Sending        /Users/mattmann/src/nutch/CHANGES.txt
    Sending        /Users/mattmann/src/nutch/src/java/org/apache/nutch/fetcher/FetcherThread.java
    Transmitting file data ...
    Committed revision 1683039.
{noformat}

> Make FetchNodeDb optional (off by default) if NutchServer is not used
> ---------------------------------------------------------------------
>
>                 Key: NUTCH-2015
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2015
>             Project: Nutch
>          Issue Type: Sub-task
>          Components: fetcher, REST_api
>            Reporter: Sujen Shah
>            Assignee: Chris A. Mattmann
>              Labels: memex
>             Fix For: 1.11
>
>
> Currently, the FetchNodes are created even if the NutchServer is not used causing memory
exceptions. This patch makes the fetcher report to the FetchNodeDb only if the crawl is invoked
from the REST service (ie NutchServer)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message