nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew McCall (JIRA)" <j...@apache.org>
Subject [jira] Created: (NUTCH-693) Add configurable option for treating nofollow behaviour.
Date Wed, 18 Feb 2009 21:00:02 GMT
Add configurable option for treating nofollow behaviour.
--------------------------------------------------------

                 Key: NUTCH-693
                 URL: https://issues.apache.org/jira/browse/NUTCH-693
             Project: Nutch
          Issue Type: New Feature
            Reporter: Andrew McCall
            Priority: Minor
         Attachments: nutch.nofollow.patch

For my purposes I'd like to follow links even if they're marked nofollow- Ideally I'd like
to follow them, but not pass the link juice between them. 

I've attached a patch that adds a configuration element parser.html.outlinks.ignore_nofollow
which allows the parser to ignore the nofollow elements on a page. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message