nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jakob Heidebrecht" <>
Subject Problems with Fetcher threads?
Date Mon, 04 Jul 2005 11:36:06 GMT

Is there a problem of fetching with many threads?

I injected a single URL to the DB and fetched in each case three circles.

First case 1 fetcher thread, second and third 20 fetcher threads.

In the first case I got 102 pages,
in the sekond 19 pages and 
in the third 22 pages.

Everything else was the same all the time.

Is this a bug?
May the server kick me out whet I'm fetching it with many threads at the
same time?



5 GB Mailbox, 50 FreeSMS
+++ GMX - die erste Adresse für Mail, Message, More +++

View raw message