nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (NUTCH-1129) Any23 Nutch plugin
Date Wed, 10 Jan 2018 16:37:01 GMT


ASF GitHub Bot commented on NUTCH-1129:

lewismc commented on a change in pull request #205: WIP: NUTCH-1129 microdata for Nutch 1.x

 File path: src/bin/crawl
 @@ -15,26 +15,32 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
-# Usage: crawl [-i|--index] [-D "key=value"] [-w|--wait] [-s <SeedDir>] [-sm <SitemapDir>]
<CrawlDir> <NumRounds>
-#    -i|--index      Indexes crawl results into a configured indexer
-#    -w|--wait       NUMBER[SUFFIX] Time to wait before generating a new segment when no
-#                    are scheduled for fetching. Suffix can be: s for second,
-#                    m for minute, h for hour and d for day. If no suffix is
-#                    specified second is used by default.
-#    -D              A Java property to pass to Nutch calls
-#    -s              Path to seeds file(s)
-#    -sm             Path to sitemap URL file(s)
-#    CrawlDir        Directory where the crawl/link/segments dirs are saved
-#    NumRounds       The number of rounds to run this crawl for
+# Usage: crawl [options] <crawl_dir> <num_rounds>
 Review comment:
   Unfortunately, i don't think that this content should be included in this patch.

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

> Any23 Nutch plugin
> ------------------
>                 Key: NUTCH-1129
>                 URL:
>             Project: Nutch
>          Issue Type: New Feature
>          Components: parser
>            Reporter: Lewis John McGibbney
>            Assignee: Lewis John McGibbney
>            Priority: Minor
>             Fix For: 2.5
>         Attachments: NUTCH-1129.patch
> This plugin should build on the Any23 library to provide us with a plugin which extracts
RDF data from HTTP and file resources. Although as of writing Any23 not part of the ASF, the
project is working towards integration into the Apache Incubator. Once the project proves
its value, this would be an excellent addition to the Nutch 1.X codebase. 

This message was sent by Atlassian JIRA

View raw message