nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Joshua Norris (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-710) Support for rel="canonical" attribute
Date Fri, 07 Feb 2014 00:52:20 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13894052#comment-13894052
] 

Joshua Norris commented on NUTCH-710:
-------------------------------------

This feature would be awesome, noticed it got put on 1.8, is this actually coming out with
1.8?

> Support for rel="canonical" attribute
> -------------------------------------
>
>                 Key: NUTCH-710
>                 URL: https://issues.apache.org/jira/browse/NUTCH-710
>             Project: Nutch
>          Issue Type: New Feature
>    Affects Versions: 1.1
>            Reporter: Frank McCown
>            Priority: Minor
>             Fix For: 2.3, 1.8
>
>         Attachments: canonical.patch
>
>
> There is a the new rel="canonical" attribute which is
> now being supported by Google, Yahoo, and Live:
> http://googlewebmastercentral.blogspot.com/2009/02/specify-your-canonical.html
> Adding support for this attribute value will potentially reduce the number of URLs crawled
and indexed and reduce duplicate page content.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message