nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2004) ParseChecker does not handle redirects
Date Thu, 30 Apr 2015 22:42:06 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522414#comment-14522414
] 

ASF GitHub Bot commented on NUTCH-2004:
---------------------------------------

GitHub user MJJoyce opened a pull request:

    https://github.com/apache/nutch/pull/23

    NUTCH-2004: Update parsechecker to handle redirects

    - Parsechecker now handles redirects if the configuration has a value
      greater than 0 set for http.redirect.max.
    - Add minor convenience function to ProtocolStatus for checking if a
      particular status is a redirect.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/MJJoyce/nutch NUTCH-2004

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/nutch/pull/23.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #23
    
----
commit 2b1188365ffba290c5cbf128bad98d1ed6eb00c2
Author: Michael Joyce <mltjoyce@gmail.com>
Date:   2015-04-30T22:26:38Z

    NUTCH-2004: Update parsechecker to handle redirects
    
    - Parsechecker now handles redirects if the configuration has a value
      greater than 0 set for http.redirect.max.
    - Add minor convenience function to ProtocolStatus for checking if a
      particular status is a redirect.

----


> ParseChecker does not handle redirects
> --------------------------------------
>
>                 Key: NUTCH-2004
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2004
>             Project: Nutch
>          Issue Type: Improvement
>    Affects Versions: 1.9
>            Reporter: Michael Joyce
>            Priority: Minor
>
> At the moment ParseChecker doesn't handle redirects. If it gets anything but a success
status it errors out. It would be nice if it handled redirects a bit more gracefully based
on the http.redirects config setting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message