nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Jelsma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (NUTCH-1380) Fetcher reducer not to configure filter/normalizers
Date Mon, 04 Jun 2012 13:10:22 GMT
Markus Jelsma created NUTCH-1380:
------------------------------------

             Summary: Fetcher reducer not to configure filter/normalizers
                 Key: NUTCH-1380
                 URL: https://issues.apache.org/jira/browse/NUTCH-1380
             Project: Nutch
          Issue Type: Improvement
          Components: fetcher
    Affects Versions: 1.5
            Reporter: Markus Jelsma
            Assignee: Markus Jelsma
            Priority: Minor
             Fix For: 1.6


The fetcher has an identity reducer but uses the configure method from the mapper, this means
large filters are loaded in the reducer as well eating up lots of unnecessary heap space.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message