nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Asitang Mishra (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2038) url filter that uses a model (from a classifier)
Date Wed, 17 Jun 2015 00:14:00 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14589069#comment-14589069
] 

Asitang Mishra commented on NUTCH-2038:
---------------------------------------

I am done with the code and Nutch integration in my branch, Will make sure about these final
pointers and upload/pull..... :D

--Add a description of the whole isuue
--Add desc of the property files and in the property files
--how to work it up desc, what files to add and what format
--format the code
--make the input file format different (more of a personal directive)
--test the classification with some basic inputs
--add comments

> url filter that uses a model (from a classifier) 
> -------------------------------------------------
>
>                 Key: NUTCH-2038
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2038
>             Project: Nutch
>          Issue Type: New Feature
>          Components: fetcher, injector, parser
>            Reporter: Asitang Mishra
>            Assignee: Chris A. Mattmann
>              Labels: memex, nutch
>             Fix For: 1.11
>
>
> A url filter that will filter out the urls (after the parsing stage,  will keep only
those urls that contain some "hot words" provided again in a list.) from that pages that are
classified irrelevant by the classifier (using a model provided).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message