Stefan,
Here is the trace in my log. My SSFetcher (for site-specific fetch) is the
same as nutch Fetcher except that the URLFilters it uses has additional
filter based on domain names. Line 363 is
throw new RuntimeException("SEVERE error logged. Exiting
fetcher.");
051224 075950 SEVERE Host connection pool not found,
hostConfig=HostConfiguration[host=https://www.kodak.com]
java.lang.RuntimeException: SEVERE error logged. Exiting fetcher.
at vscope.crawl.SSFetcher.run(SSFetcher.java:363)
at vscope.crawl.SSFetcher.main(SSFetcher.java:510)
at vscope.crawl.SSCrawler.main(SSCrawler.java:251)
Thanks,
AJ
On 12/25/05, Stefan Groschupf <sg@media-style.com> wrote:
>
> Hi,
> Can you provide a detailed stacktrace from the log file?
>
> Stefan
>
> Am 25.12.2005 um 23:38 schrieb AJ Chen:
>
> > I have seen repeatedly the following severe errors during fetching
> > 400,000 pages with 200 threads. What may cause "Host connection
> > pool not found"? This type of error must be avoided, otherwise the
> > fetcher will stop prematurely. 051224 075950 SEVERE Host
> > connection pool not found, hostConfig=HostConfiguration
> > [host=https://www.kodak.com]
> > java.lang.RuntimeException: SEVERE error logged. Exiting fetcher.
> >
> > Thanks,
> > AJ
> >
> >
>
> ---------------------------------------------------------------
> company: http://www.media-style.com
> forum: http://www.text-mining.org
> blog: http://www.find23.net
>
>
>
>
|