nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "EM" <emili...@cpuedge.com>
Subject fetching redirect bug?
Date Fri, 05 Aug 2005 20:20:28 GMT
Suppose we have to fetch 3 pages. 

Page A is http://something/login.php 
Page B is http://yyy/rrr/ which, when fetched, redirects to page A
Page C is http://yyy/ttt/ which, when fetched, redirects to page A

When fetching A, B, C the fetcher will fetch 
A
B
A
C
A

Is there any way to prevent the refetching of page A?


Mime
View raw message