nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2038) Naive Bayes classifier based url filter
Date Wed, 24 Jun 2015 16:15:06 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14599647#comment-14599647
] 

ASF GitHub Bot commented on NUTCH-2038:
---------------------------------------

Github user chrismattmann commented on a diff in the pull request:

    https://github.com/apache/nutch/pull/35#discussion_r33165388
  
    --- Diff: ivy/ivy.xml ---
    @@ -78,7 +78,11 @@
                     <dependency org="org.apache.cxf" name="cxf-rt-transports-http-jetty"
rev="3.0.4"/>
                     <dependency org="com.fasterxml.jackson.core" name="jackson-databind"
rev="2.5.1" /> 
                     <dependency org="com.fasterxml.jackson.dataformat" name="jackson-dataformat-cbor"
rev="2.5.1" />
    -                <dependency org="com.fasterxml.jackson.jaxrs" name="jackson-jaxrs-json-provider"
rev="2.5.1" />	
    +                <dependency org="com.fasterxml.jackson.jaxrs" name="jackson-jaxrs-json-provider"
rev="2.5.1" />
    +                <dependency org="org.apache.mahout" name="mahout-math" rev="0.8" />
    --- End diff --
    
    these dependencies should go into the htmlparsefilter-naivebayes/ivy.xml, not the main
one. I mentioned this last time.


> Naive Bayes classifier based url filter
> ---------------------------------------
>
>                 Key: NUTCH-2038
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2038
>             Project: Nutch
>          Issue Type: New Feature
>          Components: fetcher, injector, parser
>            Reporter: Asitang Mishra
>            Assignee: Chris A. Mattmann
>              Labels: memex, nutch
>             Fix For: 1.11
>
>
> A url filter that will filter out the urls (after the parsing stage,  will keep only
those urls that contain some "hot words" provided again in a list.) from that pages that are
classified irrelevant by the classifier.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message