nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Nagel (JIRA)" <>
Subject [jira] [Created] (NUTCH-2014) Fetcher hang-up on completion
Date Fri, 15 May 2015 20:19:59 GMT
Sebastian Nagel created NUTCH-2014:

             Summary: Fetcher hang-up on completion
                 Key: NUTCH-2014
             Project: Nutch
          Issue Type: Bug
            Reporter: Sebastian Nagel
            Priority: Critical

Although fetcher has done its work it does not shut down and exit but continues to log (and
before reports its status to the task tracker):
-activeThreads=11, spinWaiting=0, fetchQueues.totalSize=33, fetchQueues.getQueueCount=1
-activeThreads=11, spinWaiting=10, fetchQueues.totalSize=26, fetchQueues.getQueueCount=1
-activeThreads=11, spinWaiting=9, fetchQueues.totalSize=9, fetchQueues.getQueueCount=1
-activeThreads=9, spinWaiting=7, fetchQueues.totalSize=0, fetchQueues.getQueueCount=1
-activeThreads=1, spinWaiting=0, fetchQueues.totalSize=0, fetchQueues.getQueueCount=0
-activeThreads=1, spinWaiting=0, fetchQueues.totalSize=0, fetchQueues.getQueueCount=0
(last message continues)

A possible hint: activeThreads should never exceed 10 (configured per default). Looks like
the corresponding variable is lost/mixed-up during fetcher refactorization (NUTCH-1934).

This message was sent by Atlassian JIRA

View raw message