nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Nioche (JIRA)" <>
Subject [jira] [Commented] (NUTCH-1360) Suport the storing of IP address connected to when web crawling
Date Mon, 16 Dec 2013 09:28:07 GMT


Julien Nioche commented on NUTCH-1360:

Hi Lewis
Walter's patch definitely is an interesting functionality but it should be tracked in a different
issue, as you pointed out it is quite different from this one. The patch itself contains modifications
which are unrelated e.g. :
Index: src/plugin/parse-tika/src/test/org/apache/nutch/tika/
Index: src/java/org/apache/nutch/crawl/

There is an issue for the URLPartitioner to make it pluggable (NUTCH-1504) and it should use
that instead of hardcoding the changes. 

Can we move Walter's patch to a separate issue and focus on the what we already implemented
to 2.x? 

> Suport the storing of IP address connected to when web crawling
> ---------------------------------------------------------------
>                 Key: NUTCH-1360
>                 URL:
>             Project: Nutch
>          Issue Type: New Feature
>          Components: protocol
>    Affects Versions: nutchgora, 1.5
>            Reporter: Lewis John McGibbney
>            Assignee: Lewis John McGibbney
>            Priority: Minor
>             Fix For: 2.3, 1.8
>         Attachments: NUTCH-1360-NUTCH-289-nutch-1.5.1.patch, NUTCH-1360-nutchgora-v2.patch,
NUTCH-1360-nutchgora.patch, NUTCH-1360-trunk.patch, NUTCH-1360-trunkv2.patch, NUTCH-1360v3.patch,
NUTCH-1360v4.patch, NUTCH-1360v5.patch
> Simple issue enabling us to capture the specific IP address of the host which we connect
to to fetch a page.

This message was sent by Atlassian JIRA

View raw message