nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ameer Tawfik Albaham (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (NUTCH-1403) Add default ScoringFilter for manipulating metadata
Date Mon, 29 Sep 2014 09:52:33 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151545#comment-14151545
] 

Ameer Tawfik Albaham edited comment on NUTCH-1403 at 9/29/14 9:51 AM:
----------------------------------------------------------------------

Good. I also discarded the fourth one as I reached the same conclusion you just mentioned.
As I said, I have already implemented the plugin. I will be able to finish the whole thing
and prepare a patch by this weekend.



was (Author: ameertawfik):
Good. I also discarded the fourth one as I reached the same conclusion you just mentioned.
As I said, I have already implemented. I will be able to finish the whole thing and prepare
a patch by this weekend.


> Add default ScoringFilter for manipulating metadata 
> ----------------------------------------------------
>
>                 Key: NUTCH-1403
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1403
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Julien Nioche
>
> This is currently done by the urlmeta plugin, which has too vague a name and a redundant
indexing filter now that we have the index-metadata plugin. This scoring filter would help
defining which metadata to pass from : 
> - the crawl metadata to the content metadata
> - the content metadata to the parse metadata
> - the parse metadata to the crawldatum for the outlinks
> I'd make this scoring filter available by default i.e. not in a separate plugin as its
functionalities are commonly used.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message