nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2337) urlnormalizer-basic to strip empty port
Date Fri, 09 Dec 2016 11:04:58 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15734998#comment-15734998
] 

ASF GitHub Bot commented on NUTCH-2337:
---------------------------------------

GitHub user sebastian-nagel opened a pull request:

    https://github.com/apache/nutch/pull/160

    NUTCH-2337 urlnormalizer-basic to strip empty port

    - make sure that URLs which contain anything else than the host
      in the authority (incl. empty port) are marked as changed
    - always use root locale for case conversion

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/sebastian-nagel/nutch NUTCH-2337-basic-url-normalizer-empty-port

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/nutch/pull/160.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #160
    
----
commit 48918afc9cee8d8142624e511e822f7e70f31565
Author: Sebastian Nagel <snagel@apache.org>
Date:   2016-12-09T10:45:54Z

    NUTCH-2337 urlnormalizer-basic to strip empty port
    - make sure that URLs which contain anything else than the host
      in the authority (incl. empty port) are marked as changed
    - always use root locale for case conversion

----


> urlnormalizer-basic to strip empty port
> ---------------------------------------
>
>                 Key: NUTCH-2337
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2337
>             Project: Nutch
>          Issue Type: Bug
>          Components: plugin
>    Affects Versions: 1.12
>            Reporter: Sebastian Nagel
>            Assignee: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.13
>
>
> Basic URL normalizer should strip an empty port from the URL, that's not the case at
present:
> {noformat}
> echo "http://example.com:/" \
>    | nutch plugin urlnormalizer-basic org.apache.nutch.net.urlnormalizer.basic.BasicURLNormalizer
> http://example.com:/
> {noformat}
> The result should be {{http://example.com/}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message