nutch-dev mailing list archives: April 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-351) Protocol forward proxy Thu, 03 Apr, 15:16
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1739) ExecutorService field in ParseUtil.java not be right use and cause memory leak Thu, 03 Apr, 15:22
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1745) Upgrade to ElasticSearch 1.1.0 Fri, 04 Apr, 14:46
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1747) Use AtomicInteger as semaphore in Fetcher Sat, 05 Apr, 07:27
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1747) Use AtomicInteger as semaphore in Fetcher Sat, 05 Apr, 07:29
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Sat, 05 Apr, 07:33
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1735) code dedup fetcher queue redirects Sat, 05 Apr, 07:40
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1687) Pick queue in Round Robin Sat, 05 Apr, 08:31
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1747) Use AtomicInteger as semaphore in Fetcher Sat, 05 Apr, 19:55
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-385) Server delay feature conflicts with maxThreadsPerHost Sat, 05 Apr, 20:03
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-490) Extension point with filters for Neko HTML parser (with patch) Sat, 05 Apr, 20:07
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1297) it is better for fetchItemQueues to select items from greater queues first Sat, 05 Apr, 20:15
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1278) Fetch Improvement in threads per host Sat, 05 Apr, 20:19
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-410) Faster RegexNormalize with more features Sat, 05 Apr, 20:21
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-827) HTTP POST Authentication Sat, 05 Apr, 20:23
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1342) Read time out protocol-http Sat, 05 Apr, 20:25
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1750) Improvement of Fetcher's reportStatus Sun, 06 Apr, 13:05
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1750) Improvement of Fetcher's reportStatus Sun, 06 Apr, 13:09
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1750) Improvement of Fetcher's reportStatus Sun, 06 Apr, 13:16
Julien Nioche (JIRA) [jira] [Reopened] (NUTCH-385) Server delay feature conflicts with maxThreadsPerHost Mon, 07 Apr, 08:51
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1750) Improvement of Fetcher's reportStatus Wed, 09 Apr, 08:38
Julien Nioche (JIRA) [jira] [Closed] (NUTCH-1750) Improvement of Fetcher's reportStatus Wed, 09 Apr, 08:38
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1676) Add rudimentary SSL support to protocol-http Wed, 16 Apr, 14:22
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1720) Duplicate lines in HttpBase.java Wed, 16 Apr, 14:30
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1147) WebGraph nodeDumper uses only 1 reducer Wed, 16 Apr, 14:32
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1697) SegmentMerger to implement Tool Wed, 16 Apr, 14:38
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1603) ZIP parser complains about truncated PDF file Wed, 16 Apr, 14:40
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1521) CrawlDbFilter pass null url to urlNormailzers Wed, 16 Apr, 14:42
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1743) parsechecker to show outlinks Wed, 16 Apr, 14:58
Julien Nioche (JIRA) [jira] [Comment Edited] (NUTCH-1743) parsechecker to show outlinks Wed, 16 Apr, 14:58
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1743) parsechecker to show outlinks Wed, 16 Apr, 15:00
Julien Nioche (JIRA) [jira] [Issue Comment Deleted] (NUTCH-1743) parsechecker to show outlinks Wed, 16 Apr, 15:08
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1757) ParserChecker to take custom metadata as input Wed, 16 Apr, 15:14
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1757) ParserChecker to take custom metadata as input Wed, 16 Apr, 15:16
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1758) IndexChecker to send document to IndexWriters Wed, 16 Apr, 15:32
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1758) IndexChecker to send document to IndexWriters Wed, 16 Apr, 15:34
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1758) IndexChecker to send document to IndexWriters Wed, 16 Apr, 15:34
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1760) Crawl script fails to find job file if called from outside bin dir Thu, 17 Apr, 09:28
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1761) Crawl script fails to find job file if not started from inside bin dir Thu, 17 Apr, 10:04
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Thu, 17 Apr, 14:35
Julien Nioche (JIRA) [jira] [Issue Comment Deleted] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Thu, 17 Apr, 15:29
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-1197) Add statically configured field values to solrindex-mapping.xml Fri, 18 Apr, 08:24
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-685) Content-level redirect status lost in ParseSegment Fri, 18 Apr, 08:24
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-477) Extend URLFilters to support different filtering chains Fri, 18 Apr, 08:24
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-797) parse-tika is not properly constructing URLs when the target begins with a "?" Fri, 18 Apr, 08:24
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-385) Server delay feature conflicts with maxThreadsPerHost Fri, 18 Apr, 08:24
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1615) Implementing A Feature for Fetching From Websites Dump Fri, 18 Apr, 08:26
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1511) Metadata in MYSQL updated with 'garbage' Fri, 18 Apr, 08:28
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1079) StringBuffer converted to StringBuilder Fri, 18 Apr, 08:28
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1079) StringBuffer converted to StringBuilder Fri, 18 Apr, 08:30
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1625) IndexerMapReduce skips FETCH_NOTMODIFIED Fri, 18 Apr, 08:30
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1182) fetcher should track and shut down hung threads Fri, 18 Apr, 08:40
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1086) Rewrite protocol-httpclient Fri, 18 Apr, 09:05
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1270) some of Deflate encoded pages not fetched Fri, 18 Apr, 09:05
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1410) impact of a map-reduce problem Fri, 18 Apr, 09:08
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1416) IndexerMapReduce can index older version of a document instead of latest one Sun, 20 Apr, 15:56
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1416) IndexerMapReduce can index older version of a document instead of latest one Sun, 20 Apr, 16:02
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1086) Rewrite protocol-httpclient Sun, 20 Apr, 16:02
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-926) Redirections from META tag Sun, 20 Apr, 16:06
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-926) Redirections from META tag don't get filtered Sun, 20 Apr, 16:08
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-926) Redirections from META tag don't get filtered Sun, 20 Apr, 16:08
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1700) Remove deprecated code in src/plugin/creativecommons/build.xml Sun, 20 Apr, 16:30
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1665) Generator to implement Tool Sun, 20 Apr, 16:37
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1627) Debian package for installing nutch Sun, 20 Apr, 16:43
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1628) Chocolatey package for Windows users Sun, 20 Apr, 16:45
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1626) Homebrew formula for installing Nutch in Mac OS X Sun, 20 Apr, 16:45
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-797) parse-tika is not properly constructing URLs when the target begins with a "?" Sun, 27 Apr, 07:35
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-797) URL not properly constructed when link target begins with a "?" Mon, 28 Apr, 08:43
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1422) reset signature for redirects Mon, 28 Apr, 08:51
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Mon, 28 Apr, 08:59
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1759) Upgrade to Crawler Commons 0.4 Mon, 28 Apr, 11:03
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1674) Use batchId filter to enable scan (GORA-119) for Fetch,Parse,Update,Index Mon, 28 Apr, 12:14
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to use GORA_94 branch Mon, 28 Apr, 15:10
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1768) port NUTCH-1745 to Nutch 2.x (Upgrade to ElasticSearch 1.1.0) Wed, 30 Apr, 09:12
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1768) port NUTCH-1745 to Nutch 2.x (Upgrade to ElasticSearch 1.1.0) Wed, 30 Apr, 09:14
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to use GORA_94 branch Wed, 30 Apr, 12:57
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1720) Duplicate lines in HttpBase.java Wed, 30 Apr, 13:15
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1720) Duplicate lines in HttpBase.java Wed, 30 Apr, 13:15
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to use GORA_94 branch Tue, 01 Apr, 09:34
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to use GORA_94 branch Tue, 01 Apr, 10:16
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-351) Protocol forward proxy Thu, 03 Apr, 19:33
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1746) OutOfMemoryError in Mappers Fri, 04 Apr, 13:13
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1746) OutOfMemoryError in Mappers Fri, 04 Apr, 19:36
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1731) Better cmd line parsing for NutchServer Wed, 09 Apr, 19:16
Lewis John McGibbney (JIRA) [jira] [Created] (NUTCH-1755) Project name bug in build.xml Wed, 09 Apr, 23:12
Lewis John McGibbney (JIRA) [jira] [Resolved] (NUTCH-1751) Empty anchors should not index Wed, 09 Apr, 23:41
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1731) Better cmd line parsing for NutchServer Sat, 12 Apr, 21:20
Lewis John McGibbney (JIRA) [jira] [Resolved] (NUTCH-1731) Better cmd line parsing for NutchServer Mon, 14 Apr, 18:35
Lewis John McGibbney (JIRA) [jira] [Updated] (NUTCH-1731) Better cmd line parsing for NutchServer Mon, 14 Apr, 18:39
Lewis John McGibbney (JIRA) [jira] [Created] (NUTCH-1756) Security layer for NutchServer Mon, 14 Apr, 18:41
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1756) Security layer for NutchServer Mon, 14 Apr, 18:41
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1731) Better cmd line parsing for NutchServer Mon, 14 Apr, 18:43
Lewis John McGibbney (JIRA) [jira] [Commented] (NUTCH-1603) ZIP parser complains about truncated PDF file Wed, 16 Apr, 22:18
Lewis John McGibbney (JIRA) [jira] [Updated] (NUTCH-1603) ZIP parser complains about truncated PDF file Wed, 16 Apr, 22:18
Lewis John McGibbney (JIRA) [jira] [Resolved] (NUTCH-1473) Column length too big for column 'text' (max = 21845); use BLOB or TEXT instead Wed, 16 Apr, 22:22
Lewis John McGibbney (JIRA) [jira] [Closed] (NUTCH-1473) Column length too big for column 'text' (max = 21845); use BLOB or TEXT instead Wed, 16 Apr, 22:22
Lewis John McGibbney (JIRA) [jira] [Updated] (NUTCH-1164) Write JUnit tests for protocol-http Wed, 16 Apr, 22:24
Lewis John McGibbney (JIRA) [jira] [Updated] (NUTCH-992) SolrDedup is broken in 2.x Wed, 16 Apr, 22:24
Lewis John McGibbney (JIRA) [jira] [Resolved] (NUTCH-970) Injector job crashes with MySQL with table collation set to utf8_general_ci Wed, 16 Apr, 22:26
Lewis John McGibbney (JIRA) [jira] [Closed] (NUTCH-970) Injector job crashes with MySQL with table collation set to utf8_general_ci Wed, 16 Apr, 22:26
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Jun 20191
May 201979
Apr 201977
Mar 201949
Feb 201971
Jan 2019156
Dec 201844
Nov 201891
Oct 2018245
Sep 201893
Aug 201881
Jul 2018166
Jun 2018360
May 2018136
Apr 2018232
Mar 2018272
Feb 201865
Jan 2018234
Dec 2017419
Nov 2017200
Oct 2017241
Sep 2017188
Aug 2017169
Jul 2017142
Jun 2017107
May 2017126
Apr 2017128
Mar 2017119
Feb 201773
Jan 2017162
Dec 201653
Nov 201636
Oct 201691
Sep 201658
Aug 2016296
Jul 2016152
Jun 2016200
May 2016224
Apr 2016153
Mar 2016218
Feb 2016461
Jan 2016240
Dec 2015171
Nov 2015204
Oct 2015412
Sep 2015458
Aug 2015259
Jul 2015304
Jun 2015446
May 2015319
Apr 2015463
Mar 2015384
Feb 2015530
Jan 2015258
Dec 2014162
Nov 2014165
Oct 2014249
Sep 2014376
Aug 2014136
Jul 2014219
Jun 2014355
May 2014378
Apr 2014332
Mar 2014248
Feb 2014168
Jan 2014471
Dec 2013186
Nov 2013177
Oct 2013182
Sep 2013158
Aug 2013182
Jul 2013240
Jun 2013321
May 2013288
Apr 2013437
Mar 2013521
Feb 2013201
Jan 2013560
Dec 2012176
Nov 2012251
Oct 2012200
Sep 2012219
Aug 2012230
Jul 2012301
Jun 2012391
May 2012317
Apr 2012352
Mar 2012297
Feb 2012395
Jan 2012298
Dec 2011318
Nov 2011524
Oct 2011483
Sep 2011605
Aug 2011528
Jul 2011635
Jun 2011418
May 2011176
Apr 2011453
Mar 2011139
Feb 201162
Jan 2011150
Dec 2010100
Nov 201096
Oct 2010177
Sep 2010143
Aug 2010289
Jul 2010364
Jun 2010246
May 201075
Apr 2010124
Mar 2010183
Feb 2010134
Jan 2010106
Dec 200998
Nov 2009154
Oct 200988
Sep 200932
Aug 200982
Jul 200977
Jun 200994
May 2009104
Apr 200985
Mar 2009255
Feb 2009250
Jan 2009197
Dec 2008158
Nov 2008117
Oct 200884
Sep 2008101
Aug 200858
Jul 200832
Jun 200893
May 200857
Apr 200878
Mar 2008152
Feb 2008190
Jan 2008155
Dec 200768
Nov 2007188
Oct 2007179
Sep 2007189
Aug 2007135
Jul 2007283
Jun 2007241
May 2007188
Apr 2007144
Mar 2007282
Feb 2007241
Jan 2007266
Dec 2006103
Nov 2006222
Oct 2006187
Sep 2006166
Aug 2006281
Jul 2006180
Jun 2006262
May 2006282
Apr 2006247
Mar 2006304
Feb 2006349
Jan 2006558
Dec 2005412
Nov 2005288
Oct 2005313
Sep 2005339
Aug 2005426
Jul 2005228
Jun 2005178
May 2005140
Apr 2005497
Mar 2005398
Feb 200510