nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-1129) Any23 Nutch plugin
Date Thu, 08 Feb 2018 06:51:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16356551#comment-16356551
] 

ASF GitHub Bot commented on NUTCH-1129:
---------------------------------------

ferrerod commented on issue #205: WIP: NUTCH-1129 microdata for Nutch 1.x
URL: https://github.com/apache/nutch/pull/205#issuecomment-364018728
 
 
   @nmaro @lewismc I'm new to nutch and stumbled upon this merged PR after realizing I wanted
much better crawling results of sites leveraging schema.org. This is likely the wrong place
to pose my questions, but it's the first exposure to Any23 within Nutch 1.x. Do please redirect
me to a better place to post questions. And,...I may not even be asking the right questions
but here goes:
   
   Q: How do I gain Any23 microdata parsing / indexing capabilities introduced with this PR?
Do I replace  `parse-(html|tika)|index-(basic|anchor)` in plugin.includes with something like
   `parse-(html|tika|any23)|index-(basic|anchor|any23)`
   
   How do I expose the discovered microdata items to end-user such as Solr? For example, what
are the microdata items and how should I map them to Solr in `solrindex-mapping.xml`  ?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Any23 Nutch plugin
> ------------------
>
>                 Key: NUTCH-1129
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1129
>             Project: Nutch
>          Issue Type: New Feature
>          Components: parser
>            Reporter: Lewis John McGibbney
>            Assignee: Lewis John McGibbney
>            Priority: Minor
>             Fix For: 1.15
>
>         Attachments: NUTCH-1129.patch
>
>
> This plugin should build on the Any23 library to provide us with a plugin which extracts
RDF data from HTTP and file resources. Although as of writing Any23 not part of the ASF, the
project is working towards integration into the Apache Incubator. Once the project proves
its value, this would be an excellent addition to the Nutch 1.X codebase. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message