nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lewis John Mcgibbney <>
Subject [ANNOUNCE] crawler-commons 0.4 is released
Date Fri, 11 Apr 2014 18:14:14 GMT
11th April 2014 - crawler-commons 0.4 is released

We are glad to announce the 0.4 release of Crawler Commons. Amongst other
improvements, this release includes support for Googlebot-compatible
regular expressions in URL specifications, further imprvements to
robots.txt parsing and an upgrade of httpclient to v4.2.6.

See the CHANGES.txt<>
included with the release for a full list of details.

We suggest all users to upgrade to this version. Details of how to do so
can be found on Maven
(on behalf of CC team)


View raw message