nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2015) Make FetchNodeDb optional (off by default) if NutchServer is not used
Date Sat, 16 May 2015 08:36:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14546646#comment-14546646
] 

ASF GitHub Bot commented on NUTCH-2015:
---------------------------------------

GitHub user sujen1412 opened a pull request:

    https://github.com/apache/nutch/pull/25

    fix for NUTCH-2015 contributed by Sujen Shah

    

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sujen1412/nutch NUTCH-2015

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/nutch/pull/25.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #25
    
----
commit 5a6766587c8490e1c7b31eae54bce91b4411a3fa
Author: Sujen Shah <sujen1412@gmail.com>
Date:   2015-05-16T08:32:36Z

    Creation of FetchNodes is off by default if NutchServer is not used

----


> Make FetchNodeDb optional (off by default) if NutchServer is not used
> ---------------------------------------------------------------------
>
>                 Key: NUTCH-2015
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2015
>             Project: Nutch
>          Issue Type: Sub-task
>          Components: fetcher, REST_api
>            Reporter: Sujen Shah
>              Labels: memex
>             Fix For: 1.11
>
>
> Currently, the FetchNodes are created even if the NutchServer is not used causing memory
exceptions. This patch makes the fetcher report to the FetchNodeDb only if the crawl is invoked
from the REST service (ie NutchServer)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message