nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Nagel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2678) Allow for per-host configurable protocol plugin
Date Fri, 18 Jan 2019 08:54:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745926#comment-16745926
] 

Sebastian Nagel commented on NUTCH-2678:
----------------------------------------

Hi [~markus17], great! I've tested everything again: works nice including the selection of
the default protocol implementation. Btw., also nice the patch fixes  NUTCH-2653 "en passant".
I had to fix the TestProtocolFactory unit test - the test for the object cache is now obsolete
and failed. I'll open a PR including this change and will merge it if there are no objections.
Thanks!

> Allow for per-host configurable protocol plugin
> -----------------------------------------------
>
>                 Key: NUTCH-2678
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2678
>             Project: Nutch
>          Issue Type: Improvement
>          Components: protocol
>    Affects Versions: 1.15
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>            Priority: Major
>             Fix For: 1.16
>
>         Attachments: NUTCH-2678.patch, NUTCH-2678.patch, NUTCH-2678.patch, NUTCH-2678.patch
>
>
> Introduces new configuration file for mapping protocol plugins to hostnames.
> {code}
> # This file defines a hostname to protocol plugin mapping. Each line takes a
> # host name followed by a tab, followed by the ID of the protocol plugin. You
> # can find the ID in the protocol plugin's plugin.xml file.
> # 
> # <hostname>\t<plugin_id>\n
> # nutch.apache.org      org.apache.nutch.protocol.httpclient.Http
> # tika.apache.org       org.apache.nutch.protocol.http.Http
> #{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message