nutch-dev mailing list archives: May 2014

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Julien Nioche Re: [DISCUSS] Roadmap for 2.3 Release Thu, 01 May, 16:32
Julien Nioche Re: Post process Nutch data Mon, 05 May, 15:26
Julien Nioche Re: Creating Windows bash files for nutch Sun, 18 May, 14:12
Julien Nioche Re: Creating Windows bash files for nutch Sun, 18 May, 21:12
Julien Nioche Nutch survey Wed, 21 May, 15:07
Julien Nioche Re: Nutch survey Thu, 22 May, 07:10
Julien Nioche Re: Nutch survey Tue, 27 May, 17:59
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Thu, 01 May, 06:40
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1753) Eclipse dependecy problem for 2.x Thu, 01 May, 15:59
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1740) BatchId parameter is not set in DbUpdaterJob Thu, 01 May, 16:03
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1679) UpdateDb using batchId, link may override crawled page. Thu, 01 May, 16:03
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1679) UpdateDb using batchId, link may override crawled page. Thu, 01 May, 16:03
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1728) indexer-solr plugin is not delete docs from solr Thu, 01 May, 16:07
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1728) indexer-solr plugin is not delete docs from solr Thu, 01 May, 16:09
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1725) CleaningJob's reducer does not commit deleted docs. Thu, 01 May, 16:11
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1725) CleaningJob's reducer does not commit deleted docs. Thu, 01 May, 16:11
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1662) Indexer Plugin for Solr Cloud Thu, 01 May, 16:11
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1662) Indexer Plugin for Solr Cloud Thu, 01 May, 16:15
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1657) ORIGINAL_CHAR_ENCODING and CHAR_ENCODING_FOR_CONVERSION never set in HTMLParser Thu, 01 May, 16:21
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1657) ORIGINAL_CHAR_ENCODING and CHAR_ENCODING_FOR_CONVERSION never set in HTMLParser Thu, 01 May, 16:21
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1618) Fetches some websites multiple times for long lasting queues Thu, 01 May, 16:25
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1618) Fetches some websites multiple times for long lasting queues Thu, 01 May, 16:25
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1768) port NUTCH-1745 to Nutch 2.x (Upgrade to ElasticSearch 1.1.0) Fri, 02 May, 07:48
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1753) Eclipse dependecy problem for 2.x Fri, 02 May, 07:50
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Fri, 02 May, 08:29
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1622) Create Outlinks with metadata Fri, 02 May, 08:35
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-1622) Create Outlinks with metadata Fri, 02 May, 08:41
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1622) Create Outlinks with metadata Fri, 02 May, 08:41
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1622) Create Outlinks with metadata Fri, 02 May, 09:11
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Fri, 02 May, 11:23
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1674) Use batchId filter to enable scan (GORA-119) for Fetch,Parse,Update,Index Fri, 02 May, 11:29
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1741) Support of Sitemaps in Nutch 2.x Fri, 02 May, 11:31
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1674) Use batchId filter to enable scan (GORA-119) for Fetch,Parse,Update,Index Fri, 02 May, 15:18
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1768) port NUTCH-1745 to Nutch 2.x (Upgrade to ElasticSearch 1.1.0) Fri, 02 May, 15:40
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 21:55
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1622) Create Outlinks with metadata Sat, 10 May, 22:05
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1622) Create Outlinks with metadata Sat, 10 May, 22:05
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Sat, 10 May, 22:05
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Sat, 10 May, 22:06
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 22:10
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 22:15
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 22:15
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1770) Nutch is failing to parse all PDFs Sat, 10 May, 22:15
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1770) Nutch is failing to parse all PDFs Sat, 10 May, 22:15
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Comment Edited] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1570) Add filtering capability to Datastore Queries Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1570) Add filtering capability to Datastore Queries Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1570) Add filtering capability to Datastore Queries Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1570) Add filtering capability to Datastore Queries Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1679) UpdateDb using batchId, link may override crawled page. Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Comment Edited] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Sat, 10 May, 22:16
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1770) Nutch is failing to parse all PDFs Mon, 12 May, 07:52
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-1766) Generator to unlock crawldb and remove tempdir if generate job fails Mon, 12 May, 07:59
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1766) Generator to unlock crawldb and remove tempdir if generate job fails Mon, 12 May, 07:59
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1766) Generator to unlock crawldb and remove tempdir if generate job fails Mon, 12 May, 08:01
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Mon, 12 May, 08:11
Julien Nioche (JIRA) [jira] [Assigned] (NUTCH-1676) Add rudimentary SSL support to protocol-http Mon, 12 May, 12:43
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1613) Timeouts in protocol-httpclient when crawling same host with >2 threads and added cookie strings for both http protocols Mon, 12 May, 12:55
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1613) Timeouts in protocol-httpclient when crawling same host with >2 threads and added cookie strings for both http protocols Mon, 12 May, 13:00
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1752) cache robots.txt rules per protocol:host:port Mon, 12 May, 13:06
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1669) FTP crawl does not use FTP's server root folder Mon, 12 May, 13:12
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1772) Injector does not need merging if no pre-existing crawldb Mon, 12 May, 15:31
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1772) Injector does not need merging if no pre-existing crawldb Mon, 12 May, 15:33
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Wed, 14 May, 08:36
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1697) SegmentMerger to implement Tool Wed, 14 May, 08:48
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1772) Injector does not need merging if no pre-existing crawldb Wed, 14 May, 08:55
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Fri, 16 May, 10:54
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-207) Bandwidth target for fetcher rather than a thread count Fri, 16 May, 11:19
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1772) Injector does not need merging if no pre-existing crawldb Fri, 16 May, 11:19
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1770) Nutch is failing to parse all PDFs Fri, 16 May, 11:19
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1770) Nutch is failing to parse all PDFs Fri, 16 May, 11:19
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Fri, 16 May, 11:22
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1714) Nutch 2.x upgrade to Gora 0.4 Fri, 16 May, 11:22
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1674) Use batchId filter to enable scan (GORA-119) for Fetch,Parse,Update,Index Fri, 16 May, 11:23
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1778) Generator not logging number of URLs in batch correctly Fri, 16 May, 11:23
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1777) Fetcher not getting all the entries in input Fri, 16 May, 11:23
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1709) Generated classes o.a.n.storage.Host and o.a.n.storage.ProtocolStatus contain methods not defined in source .avsc Fri, 16 May, 11:23
Julien Nioche (JIRA) [jira] [Created] (NUTCH-1779) Apply formatting to the code Fri, 16 May, 11:23
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1768) port NUTCH-1745 to Nutch 2.x (Upgrade to ElasticSearch 1.1.0) Fri, 16 May, 11:23
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1772) Injector does not need merging if no pre-existing crawldb Fri, 16 May, 11:23
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1676) Add rudimentary SSL support to protocol-http Fri, 16 May, 13:44
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1773) Solr Indexer fails Mon, 19 May, 14:07
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1622) Create Outlinks with metadata Mon, 19 May, 20:09
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1704) Port DomainBlacklist urlfilter to 2.x Mon, 19 May, 20:17
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1634) readdb -stats show the result twice Mon, 19 May, 20:21
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1765) SolrClean to remove redirected URLs from Solr Mon, 19 May, 20:23
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1765) SolrClean to remove redirected URLs from Solr Mon, 19 May, 20:25
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1757) ParserChecker to take custom metadata as input Mon, 19 May, 20:27
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1757) ParserChecker to take custom metadata as input Mon, 19 May, 20:27
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1758) IndexChecker to send document to IndexWriters Mon, 19 May, 20:27
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1758) IndexChecker to send document to IndexWriters Mon, 19 May, 20:27
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1678) Remove dependency on org.apache.oro Mon, 19 May, 20:29
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1722) FetcherJob#fetch throws NullPointerException for null batchId Mon, 19 May, 20:33
Julien Nioche (JIRA) [jira] [Resolved] (NUTCH-1068) Automaton performance improvements based on Lucene code base Mon, 19 May, 20:39
Julien Nioche (JIRA) [jira] [Updated] (NUTCH-1526) Create SegmentContentDumperTool for easily extracting out file contents from SegmentDirs Mon, 19 May, 20:39
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1526) Create SegmentContentDumperTool for easily extracting out file contents from SegmentDirs Mon, 19 May, 20:45
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1746) OutOfMemoryError in Mappers Mon, 19 May, 21:07
Julien Nioche (JIRA) [jira] [Commented] (NUTCH-1758) IndexChecker to send document to IndexWriters Wed, 21 May, 07:38
Message list« Previous · 1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
Jan 202180
Dec 202058
Nov 202051
Oct 202025
Sep 202038
Aug 2020166
Jul 2020140
Jun 2020146
May 202053
Apr 2020168
Mar 202022
Feb 202048
Jan 202068
Dec 201973
Nov 2019177
Oct 2019136
Sep 2019203
Aug 201969
Jul 201946
Jun 201910
May 201979
Apr 201977
Mar 201949
Feb 201971
Jan 2019156
Dec 201844
Nov 201891
Oct 2018245
Sep 201893
Aug 201881
Jul 2018166
Jun 2018360
May 2018136
Apr 2018232
Mar 2018272
Feb 201865
Jan 2018234
Dec 2017419
Nov 2017200
Oct 2017241
Sep 2017188
Aug 2017169
Jul 2017142
Jun 2017107
May 2017126
Apr 2017128
Mar 2017119
Feb 201773
Jan 2017162
Dec 201653
Nov 201636
Oct 201691
Sep 201658
Aug 2016296
Jul 2016152
Jun 2016200
May 2016224
Apr 2016153
Mar 2016218
Feb 2016461
Jan 2016240
Dec 2015171
Nov 2015204
Oct 2015412
Sep 2015458
Aug 2015259
Jul 2015304
Jun 2015446
May 2015319
Apr 2015463
Mar 2015384
Feb 2015530
Jan 2015258
Dec 2014162
Nov 2014165
Oct 2014249
Sep 2014376
Aug 2014136
Jul 2014219
Jun 2014355
May 2014378
Apr 2014332
Mar 2014248
Feb 2014168
Jan 2014471
Dec 2013186
Nov 2013177
Oct 2013182
Sep 2013158
Aug 2013182
Jul 2013240
Jun 2013321
May 2013288
Apr 2013437
Mar 2013521
Feb 2013201
Jan 2013560
Dec 2012176
Nov 2012251
Oct 2012200
Sep 2012219
Aug 2012230
Jul 2012301
Jun 2012391
May 2012317
Apr 2012352
Mar 2012297
Feb 2012395
Jan 2012298
Dec 2011318
Nov 2011524
Oct 2011483
Sep 2011605
Aug 2011528
Jul 2011635
Jun 2011418
May 2011176
Apr 2011453
Mar 2011139
Feb 201162
Jan 2011150
Dec 2010100
Nov 201096
Oct 2010177
Sep 2010143
Aug 2010289
Jul 2010364
Jun 2010246
May 201075
Apr 2010124
Mar 2010183
Feb 2010134
Jan 2010106
Dec 200998
Nov 2009154
Oct 200988
Sep 200932
Aug 200982
Jul 200977
Jun 200994
May 2009104
Apr 200985
Mar 2009255
Feb 2009250
Jan 2009197
Dec 2008158
Nov 2008117
Oct 200884
Sep 2008101
Aug 200858
Jul 200832
Jun 200893
May 200857
Apr 200878
Mar 2008152
Feb 2008190
Jan 2008155
Dec 200768
Nov 2007188
Oct 2007179
Sep 2007189
Aug 2007135
Jul 2007283
Jun 2007241
May 2007188
Apr 2007144
Mar 2007282
Feb 2007241
Jan 2007266
Dec 2006103
Nov 2006222
Oct 2006187
Sep 2006166
Aug 2006281
Jul 2006180
Jun 2006262
May 2006282
Apr 2006247
Mar 2006304
Feb 2006349
Jan 2006558
Dec 2005412
Nov 2005288
Oct 2005313
Sep 2005339
Aug 2005426
Jul 2005228
Jun 2005178
May 2005140
Apr 2005497
Mar 2005398
Feb 200510