nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Julien Nioche (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (NUTCH-2064) URLNormalizer basic to properly encode non-ASCII characters
Date Fri, 04 Sep 2015 17:39:45 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14731114#comment-14731114
] 

Julien Nioche edited comment on NUTCH-2064 at 9/4/15 5:39 PM:
--------------------------------------------------------------

What about moving the basic URL normalizer to Crawler-Commons? see [https://github.com/crawler-commons/crawler-commons/issues/74]
We already rely on it for robots parsing and it other projects would be able to reuse it (as
well as improve it). Any views on this?

See related issues [https://issues.apache.org/jira/issues/?jql=labels%20%3D%20crawler-commons]


was (Author: jnioche):
What about moving the basic URL normalizer to Crawler-Commons? see [https://github.com/crawler-commons/crawler-commons/issues/74]
We already rely on it for robots parsing and it other projects would be able to reuse it (as
well as improve it). Any views on this?

> URLNormalizer basic to properly encode non-ASCII characters
> -----------------------------------------------------------
>
>                 Key: NUTCH-2064
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2064
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: 1.10
>            Reporter: Markus Jelsma
>             Fix For: 1.11
>
>         Attachments: NUTCH-1098.patch, NUTCH-1098.patch, NUTCH-2064-v3.patch, NUTCH-2064.patch
>
>
> NUTCH-1098 rewritten to work on trunk. Unit test is identical to 1098.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message