nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Nagel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1636) Indexer to normalize and filter repr URL
Date Sun, 08 Sep 2013 20:49:51 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761525#comment-13761525
] 

Sebastian Nagel commented on NUTCH-1636:
----------------------------------------

Reported by Iain Lopata [[1|http://mail-archives.apache.org/mod_mbox/nutch-user/201309.mbox/%3CSNT149-DS13EBCF60B4E83801BB5753903C0@phx.gbl%3E]].
                
> Indexer to normalize and filter repr URL
> ----------------------------------------
>
>                 Key: NUTCH-1636
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1636
>             Project: Nutch
>          Issue Type: Bug
>          Components: indexer
>    Affects Versions: 1.6, 1.7
>            Reporter: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.8
>
>         Attachments: NUTCH-1636-1.patch
>
>
> Indexer if used with option -normalize and/or -filter (cf. NUTCH-1300) should also normalize
and filter representation URLs. Otherwise URLs which are target of a redirect, and have repr
URL set (see URLUtil.chooseRepr) may show up in index with an undesirable URL.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message