nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1998) Add support for user-defined file extension to CommonCrawlDataDumper
Date Mon, 11 May 2015 21:57:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538712#comment-14538712
] 

Hudson commented on NUTCH-1998:
-------------------------------

SUCCESS: Integrated in Nutch-trunk #3115 (See [https://builds.apache.org/job/Nutch-trunk/3115/])
NUTCH-1998 Add support for user-defined file extension to CommonCrawlDataDumper: fix unit
test (snagel: http://svn.apache.org/viewvc/nutch/trunk/?view=rev&rev=1678824)
* /nutch/trunk/CHANGES.txt
* /nutch/trunk/src/test/org/apache/nutch/tools/TestCommonCrawlDataDumper.java


> Add support for user-defined file extension to CommonCrawlDataDumper
> --------------------------------------------------------------------
>
>                 Key: NUTCH-1998
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1998
>             Project: Nutch
>          Issue Type: Improvement
>          Components: tool
>            Reporter: Giuseppe Totaro
>            Assignee: Chris A. Mattmann
>            Priority: Minor
>              Labels: memex, patch
>             Fix For: 1.11
>
>         Attachments: NUTCH-1998.patch
>
>
> {{CommonCrawlDataDumper}} tool is able to generate CBOR-encoded files, extracted from
Nutch crawled data, using the Common Crawl format. By default, {{CommonCrawlDataDumper}} uses
the original file extension.
> We are going to add support for a command-line option (e.g., {{-extension}}) that allows
the user to provide a file extension to use in place of the original one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message