nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yogendra Kumar Soni (JIRA)" <>
Subject [jira] [Updated] (NUTCH-2134) Redirection and cookie handling using protocol plugins
Date Thu, 08 Oct 2015 07:02:27 GMT


Yogendra Kumar Soni updated NUTCH-2134:
    Component/s: protocol

> Redirection and cookie handling using protocol  plugins
> -------------------------------------------------------
>                 Key: NUTCH-2134
>                 URL:
>             Project: Nutch
>          Issue Type: Improvement
>          Components: fetcher, plugin, protocol
>    Affects Versions: 1.11
>            Reporter: Yogendra Kumar Soni
>            Priority: Minor
> fetcher thread is handling redirection logic and it is failing where redirection 301
takes to some other domain and get authentication cookies from there and again redirects to
same url with cookies (even if domain is in urlfilter). HttpClient 4.5 uses automatic redirection
handling with cookies, which is working well. In place of handling redirects in fetcherThread
we can enable user to use HTTPclients 4.5 redirection handling. In other words  enable redirection
handling logic selection using HttpBase or protocol plugin.

This message was sent by Atlassian JIRA

View raw message