nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1636) Indexer to normalize and filter repr URL
Date Fri, 20 Sep 2013 22:32:53 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13773536#comment-13773536
] 

Hudson commented on NUTCH-1636:
-------------------------------

SUCCESS: Integrated in Nutch-trunk #2359 (See [https://builds.apache.org/job/Nutch-trunk/2359/])
NUTCH-1636 Indexer to normalize and filter repr URL (snagel: http://svn.apache.org/viewvc/nutch/trunk/?view=rev&rev=1525148)
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/src/java/org/apache/nutch/indexer/IndexerMapReduce.java

                
> Indexer to normalize and filter repr URL
> ----------------------------------------
>
>                 Key: NUTCH-1636
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1636
>             Project: Nutch
>          Issue Type: Bug
>          Components: indexer
>    Affects Versions: 1.6, 1.7
>            Reporter: Sebastian Nagel
>            Priority: Minor
>             Fix For: 1.8
>
>         Attachments: NUTCH-1636-1.patch
>
>
> Indexer if used with option -normalize and/or -filter (cf. NUTCH-1300) should also normalize
and filter representation URLs. Otherwise URLs which are target of a redirect, and have repr
URL set (see URLUtil.chooseRepr) may show up in index with an undesirable URL.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message