nutch-dev mailing list archives: December 2017

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2419) Domain blacklist URL filter does not respect command-line override for file Fri, 15 Dec, 16:09
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2334) Extension point for schedulers Fri, 15 Dec, 16:09
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2261) ParseSegment job does not pass metadata for content-level redirects Fri, 15 Dec, 16:09
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2035) Regex filter using case sensitive rules. Fri, 15 Dec, 16:53
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2439) Upgrade to Apache Tika 1.17 Fri, 15 Dec, 17:19
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2480) Upgrade crawler-commons dependency to 0.9 Fri, 15 Dec, 19:37
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2354) Upgrade Hadoop dependencies to 2.7.4 Fri, 15 Dec, 19:39
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2478) // is not a valid base URL Fri, 15 Dec, 20:47
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2362) Upgrade MaxMind GeoIP version in index-geoip Fri, 15 Dec, 20:49
Sebastian Nagel (JIRA) [jira] [Created] (NUTCH-2483) Remove/replace indirect dependencies to org.json Sat, 16 Dec, 17:20
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2429) Fix Plugin System to allow protocol plugins to bundle their URLStreamHandlers Sat, 16 Dec, 17:23
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2429) Fix Plugin System to allow protocol plugins to bundle their URLStreamHandlers Sat, 16 Dec, 17:23
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2390) No documentation on pluggable indexing Sat, 16 Dec, 17:23
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2387) Nutch should not index document with "noindex" meta Sat, 16 Dec, 17:25
Sebastian Nagel (JIRA) [jira] [Assigned] (NUTCH-2365) HTTP Redirects to SubDomains don't get crawled Sun, 17 Dec, 10:51
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2365) HTTP Redirects to SubDomains don't get crawled Sun, 17 Dec, 10:52
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2365) HTTP Redirects to SubDomains don't get crawled if db.ignore.external.links.mode == byDomain Sun, 17 Dec, 10:53
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2365) HTTP Redirects to SubDomains don't get crawled if Sun, 17 Dec, 10:53
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2152) CommonCrawl dump via Service endpoint Sun, 17 Dec, 10:54
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2239) Selenium Handlers for Ajax Patterns from Student submissions Sun, 17 Dec, 10:54
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-1749) Optionally exclude title from content field Sun, 17 Dec, 10:57
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-1917) index.parse.md, index.content.md and index.db.md should support wildcard Sun, 17 Dec, 10:58
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-1917) index.parse.md, index.content.md and index.db.md should support wildcard Sun, 17 Dec, 10:58
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2184) Enable IndexingJob to function with no crawldb Sun, 17 Dec, 11:14
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2140) Atomic update and optimistic concurrency update using Solr Sun, 17 Dec, 11:15
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2186) -addBinaryContent flag can cause "String length must be a multiple of four" error in IndexingJob Sun, 17 Dec, 11:15
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2251) Make CommonCrawlFormatJackson instance reusable by properly handling object state Sun, 17 Dec, 11:16
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2207) Remove class duplication and smarten-up scoring-similarity plugin Sun, 17 Dec, 11:18
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2380) indexer-elastic version bump Sun, 17 Dec, 11:23
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2237) DeduplicationJob: Add extra order criteria based on slug Sun, 17 Dec, 11:27
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2267) Solr indexer fails at the end of the job with a java error message Sun, 17 Dec, 11:30
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2267) Solr indexer fails at the end of the job with a java error message Sun, 17 Dec, 11:30
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2478) // is not a valid base URL Sun, 17 Dec, 11:35
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2459) Nutch cannot download/parse some files via FTP Sun, 17 Dec, 11:38
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2477) Refactor *Checker classes to use base class for common code Sun, 17 Dec, 12:03
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2431) URLFilterchecker to implement Tool-interface Sun, 17 Dec, 13:18
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2477) Refactor *Checker classes to use base class for common code Sun, 17 Dec, 13:23
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2320) URLFilterChecker to run as TCP Telnet service Sun, 17 Dec, 13:24
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2338) URLNormalizerChecker to run as TCP Telnet service Sun, 17 Dec, 13:24
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2431) URLFilterchecker to implement Tool-interface Sun, 17 Dec, 13:24
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2322) URL not available for Jexl operations Sun, 17 Dec, 14:37
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2370) FileDumper: save JSON mapping file -> URL Sun, 17 Dec, 14:46
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2321) Indexing filter checker leaks threads Sun, 17 Dec, 15:14
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2034) CrawlDB filtered documents counter. Sun, 17 Dec, 15:17
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2370) FileDumper: save JSON mapping file -> URL Sun, 17 Dec, 15:17
Sebastian Nagel (JIRA) [jira] [Assigned] (NUTCH-2370) FileDumper: save JSON mapping file -> URL Sun, 17 Dec, 15:17
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2431) URLFilterchecker to implement Tool-interface Mon, 18 Dec, 13:00
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2431) URLFilterchecker to implement Tool-interface Mon, 18 Dec, 13:06
Sebastian Nagel (JIRA) [jira] [Reopened] (NUTCH-2353) Create seed file with metadata using the REST API Mon, 18 Dec, 13:49
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2353) Create seed file with metadata using the REST API Mon, 18 Dec, 13:50
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2447) Work-around SSLProtocolException: handshake alert: unrecognized_name Mon, 18 Dec, 13:57
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2461) Generate passes the data to when maxCount == 0 Mon, 18 Dec, 13:57
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2161) Interrupted failed and/or killed tasks fail to clean up temp directories in HDFS Mon, 18 Dec, 13:57
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2248) CSS parser plugin Mon, 18 Dec, 14:00
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2310) Protocol-Selenium does not support HTTPS protocol Mon, 18 Dec, 14:00
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2290) Update licenses of bundled libraries Mon, 18 Dec, 14:00
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2295) Nutch master docker container broken Mon, 18 Dec, 14:00
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2382) indexer-hbase Nutch 1.x branch Mon, 18 Dec, 14:05
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2417) Support for variable fetch delay via FreeGenerator Mon, 18 Dec, 14:05
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2441) ARG_SEGMENT usage Mon, 18 Dec, 14:06
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2467) Sitemap type field can be null Mon, 18 Dec, 14:07
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2454) REST API fix for usage of hostdb in generator Mon, 18 Dec, 14:07
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2321) Indexing filter checker leaks threads Mon, 18 Dec, 14:09
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2416) Fetcher to log thread ID Mon, 18 Dec, 14:10
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2432) Protocol httpclient to disable cookies if http.enable.cookie.header is false Mon, 18 Dec, 14:10
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2411) Index-metadata to support indexing multiple values for a field Mon, 18 Dec, 14:10
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2466) Sitemap processor to follow redirects Mon, 18 Dec, 14:10
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2415) Create a JEXL based IndexingFilter Mon, 18 Dec, 14:18
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2381) In some situations the class TextProfileSignature gives different signatures for the same text "profile" page. Mon, 18 Dec, 14:18
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2295) Nutch master docker container broken Mon, 18 Dec, 14:49
Sebastian Nagel (JIRA) [jira] [Assigned] (NUTCH-2295) Nutch master docker container broken Mon, 18 Dec, 14:49
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2415) Create a JEXL based IndexingFilter Mon, 18 Dec, 15:52
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2216) db.ignore.*.links to optionally follow internal redirects Mon, 18 Dec, 16:07
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2380) indexer-elastic version upgrade to 5.3.0 Mon, 18 Dec, 16:25
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2380) indexer-elastic version upgrade to 5.3.0 Mon, 18 Dec, 16:26
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2365) HTTP Redirects to SubDomains don't get crawled if db.ignore.external.links.mode == byDomain Mon, 18 Dec, 16:32
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2216) db.ignore.*.links to optionally follow internal redirects Mon, 18 Dec, 16:33
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2295) Nutch master docker container broken Mon, 18 Dec, 16:35
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2483) Remove/replace indirect dependencies to org.json Mon, 18 Dec, 17:13
Sebastian Nagel (JIRA) [jira] [Commented] (NUTCH-2353) Create seed file with metadata using the REST API Mon, 18 Dec, 17:16
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2353) Create seed file with metadata using the REST API Mon, 18 Dec, 17:17
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2185) protocol-soda-consumer plugin Mon, 18 Dec, 17:24
Sebastian Nagel (JIRA) [jira] [Reopened] (NUTCH-2392) Get same pages multiple times if URL contains relative path Mon, 18 Dec, 17:25
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2392) Get same pages multiple times if URL contains relative path Mon, 18 Dec, 17:25
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2392) Get same pages multiple times if URL contains relative path Mon, 18 Dec, 17:26
Sebastian Nagel (JIRA) [jira] [Reopened] (NUTCH-2212) Decrease memory consumption by tuning stack size Mon, 18 Dec, 17:27
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2212) Decrease memory consumption by tuning stack size Mon, 18 Dec, 17:27
Sebastian Nagel (JIRA) [jira] [Reopened] (NUTCH-2212) Decrease memory consumption by tuning stack size Mon, 18 Dec, 17:27
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2212) Decrease memory consumption by tuning stack size Mon, 18 Dec, 17:27
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2392) Get same pages multiple times if URL contains relative path Mon, 18 Dec, 17:28
Sebastian Nagel (JIRA) [jira] [Reopened] (NUTCH-2392) Get same pages multiple times if URL contains relative path Mon, 18 Dec, 17:28
Sebastian Nagel (JIRA) [jira] [Resolved] (NUTCH-2212) Decrease memory consumption by tuning stack size Mon, 18 Dec, 17:28
Sebastian Nagel (JIRA) [jira] [Updated] (NUTCH-2486) Compiler Warning: Unchecked / unsafe operations in MimeTypeIndexingFilter Tue, 19 Dec, 15:19
Sebb (JIRA) [jira] [Created] (NUTCH-2488) Please use SSL (https) for KEYS, sigs, hashes Wed, 27 Dec, 19:25
Semyon Semyonov Re: [VOTE] Release Apache Nutch 1.14 RC#1 Tue, 19 Dec, 09:45
Semyon Semyonov Re: [VOTE] Release Apache Nutch 1.14 RC#1 Tue, 19 Dec, 11:56
Semyon Semyonov Re: [VOTE] Release Apache Nutch 1.14 RC#1 Tue, 19 Dec, 19:34
Semyon Semyonov Re: RE: [VOTE] Release Apache Nutch 1.14 RC#1 Wed, 20 Dec, 06:22
Semyon Semyonov Eclipse problems cannot convert from org.apache.lucene.analysis.CharArraySet to org.apache.lucene.analysis.util.CharArraySet  Thu, 28 Dec, 15:04
Semyon Semyonov Re: RE: Eclipse problems cannot convert from org.apache.lucene.analysis.CharArraySet to org.apache.lucene.analysis.util.CharArraySet  Thu, 28 Dec, 15:23
Message list« Previous · 1 · 2 · 3 · 4 · 5 · Next »Thread · Author · Date
Box list
Aug 201921
Jul 201946
Jun 201910
May 201979
Apr 201977
Mar 201949
Feb 201971
Jan 2019156
Dec 201844
Nov 201891
Oct 2018245
Sep 201893
Aug 201881
Jul 2018166
Jun 2018360
May 2018136
Apr 2018232
Mar 2018272
Feb 201865
Jan 2018234
Dec 2017419
Nov 2017200
Oct 2017241
Sep 2017188
Aug 2017169
Jul 2017142
Jun 2017107
May 2017126
Apr 2017128
Mar 2017119
Feb 201773
Jan 2017162
Dec 201653
Nov 201636
Oct 201691
Sep 201658
Aug 2016296
Jul 2016152
Jun 2016200
May 2016224
Apr 2016153
Mar 2016218
Feb 2016461
Jan 2016240
Dec 2015171
Nov 2015204
Oct 2015412
Sep 2015458
Aug 2015259
Jul 2015304
Jun 2015446
May 2015319
Apr 2015463
Mar 2015384
Feb 2015530
Jan 2015258
Dec 2014162
Nov 2014165
Oct 2014249
Sep 2014376
Aug 2014136
Jul 2014219
Jun 2014355
May 2014378
Apr 2014332
Mar 2014248
Feb 2014168
Jan 2014471
Dec 2013186
Nov 2013177
Oct 2013182
Sep 2013158
Aug 2013182
Jul 2013240
Jun 2013321
May 2013288
Apr 2013437
Mar 2013521
Feb 2013201
Jan 2013560
Dec 2012176
Nov 2012251
Oct 2012200
Sep 2012219
Aug 2012230
Jul 2012301
Jun 2012391
May 2012317
Apr 2012352
Mar 2012297
Feb 2012395
Jan 2012298
Dec 2011318
Nov 2011524
Oct 2011483
Sep 2011605
Aug 2011528
Jul 2011635
Jun 2011418
May 2011176
Apr 2011453
Mar 2011139
Feb 201162
Jan 2011150
Dec 2010100
Nov 201096
Oct 2010177
Sep 2010143
Aug 2010289
Jul 2010364
Jun 2010246
May 201075
Apr 2010124
Mar 2010183
Feb 2010134
Jan 2010106
Dec 200998
Nov 2009154
Oct 200988
Sep 200932
Aug 200982
Jul 200977
Jun 200994
May 2009104
Apr 200985
Mar 2009255
Feb 2009250
Jan 2009197
Dec 2008158
Nov 2008117
Oct 200884
Sep 2008101
Aug 200858
Jul 200832
Jun 200893
May 200857
Apr 200878
Mar 2008152
Feb 2008190
Jan 2008155
Dec 200768
Nov 2007188
Oct 2007179
Sep 2007189
Aug 2007135
Jul 2007283
Jun 2007241
May 2007188
Apr 2007144
Mar 2007282
Feb 2007241
Jan 2007266
Dec 2006103
Nov 2006222
Oct 2006187
Sep 2006166
Aug 2006281
Jul 2006180
Jun 2006262
May 2006282
Apr 2006247
Mar 2006304
Feb 2006349
Jan 2006558
Dec 2005412
Nov 2005288
Oct 2005313
Sep 2005339
Aug 2005426
Jul 2005228
Jun 2005178
May 2005140
Apr 2005497
Mar 2005398
Feb 200510