nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jakob Heidebrecht" <Jakob.h...@gmx.de>
Subject Problems with Fetcher threads?
Date Mon, 04 Jul 2005 11:36:06 GMT
Hallo,

Is there a problem of fetching with many threads?

I injected a single URL to the DB and fetched in each case three circles.

First case 1 fetcher thread, second and third 20 fetcher threads.

In the first case I got 102 pages,
in the sekond 19 pages and 
in the third 22 pages.

Everything else was the same all the time.

Is this a bug?
May the server kick me out whet I'm fetching it with many threads at the
same time?

Regards,

Jakob

-- 
5 GB Mailbox, 50 FreeSMS http://www.gmx.net/de/go/promail
+++ GMX - die erste Adresse für Mail, Message, More +++

Mime
View raw message