nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Apache Wiki <wikidi...@apache.org>
Subject [Nutch Wiki] Update of "FetchCycleOverlap" by OtisGospodnetic
Date Thu, 24 Apr 2008 04:03:41 GMT
Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Nutch Wiki" for change notification.

The following page has been changed by OtisGospodnetic:
http://wiki.apache.org/nutch/FetchCycleOverlap

------------------------------------------------------------------------------
  
  2. run a fetcher job (uses M-2 maps and later all R reduces)
  
- 3. at this point there are 2 open map slots for something else to run, say the updatedb
job for the previously fetched/parsed segment
+ 3. at this point, while the fetch job is still running, there are 2 open map slots for something
else to run, say the updatedb job for the previously fetched/parsed segment
  
  4. when updatedb job is done the cluster can take on more jobs.  Any completed tasks (C)
from the running fetcher job represent "open work slots"
  

Mime
View raw message