nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Taichi Ho <heyuehengtai...@gmail.com>
Subject Redirection in nutch
Date Sat, 03 Oct 2015 07:22:29 GMT
Hi, all.

I want to handle redirection in nutch and found this website that hasn't
been updated for years.
http://wiki.apache.org/nutch/RedirectHandling

I tried to set http.redirect.max as the following says:
http://stackoverflow.com/questions/17592948/nutch-redirection-handling-issue

But the redirection doesn't work and nutch keep fetching the same url until
the max count is reached.

Is this a bug?
It seems to have been fixed in 1.10. But it still doesn't work.
https://github.com/apache/nutch/commit/ed052df8822380ccfa89a9ffa1df324933669a59

Thanks.

Mime
View raw message