nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Nioche (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1360) Suport the storing of IP address connected to when web crawling
Date Mon, 16 Dec 2013 09:28:07 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13848950#comment-13848950
] 

Julien Nioche commented on NUTCH-1360:
--------------------------------------

Hi Lewis
Walter's patch definitely is an interesting functionality but it should be tracked in a different
issue, as you pointed out it is quite different from this one. The patch itself contains modifications
which are unrelated e.g. :
Index: src/plugin/parse-tika/src/test/org/apache/nutch/tika/TestMSWordParser.java
Index: src/java/org/apache/nutch/crawl/MimeAdaptiveFetchSchedule.java

There is an issue for the URLPartitioner to make it pluggable (NUTCH-1504) and it should use
that instead of hardcoding the changes. 

Can we move Walter's patch to a separate issue and focus on the what we already implemented
to 2.x? 

> Suport the storing of IP address connected to when web crawling
> ---------------------------------------------------------------
>
>                 Key: NUTCH-1360
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1360
>             Project: Nutch
>          Issue Type: New Feature
>          Components: protocol
>    Affects Versions: nutchgora, 1.5
>            Reporter: Lewis John McGibbney
>            Assignee: Lewis John McGibbney
>            Priority: Minor
>             Fix For: 2.3, 1.8
>
>         Attachments: NUTCH-1360-NUTCH-289-nutch-1.5.1.patch, NUTCH-1360-nutchgora-v2.patch,
NUTCH-1360-nutchgora.patch, NUTCH-1360-trunk.patch, NUTCH-1360-trunkv2.patch, NUTCH-1360v3.patch,
NUTCH-1360v4.patch, NUTCH-1360v5.patch
>
>
> Simple issue enabling us to capture the specific IP address of the host which we connect
to to fetch a page.



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Mime
View raw message