nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (NUTCH-2209) Improved Tokenization for Similarity Scoring plugin
Date Wed, 03 Feb 2016 02:25:39 GMT


ASF GitHub Bot commented on NUTCH-2209:

Github user sujen1412 commented on a diff in the pull request:
    --- Diff: conf/nutch-default.xml ---
    @@ -1390,7 +1390,7 @@ For more detailed information on the working of this filter
    -    <name>scoring.similarity.model.path</name>
    +    <name>cosine.goldstandard.file</name>
         <description>Path to the gold standard file which contains all the relevant
text and terms, 
    --- End diff --
    It is a goldstandard file now and the model containing the term vector gets created at
runtime. I felt the earlier name was misleading and given that we could have more similarity
metrics in the future,  I renamed it. 
    Later on if we can incorporate the idea of a corpus of documents, we can rename it to
something like cosine.corpus.path ? 

> Improved Tokenization for Similarity Scoring plugin
> ---------------------------------------------------
>                 Key: NUTCH-2209
>                 URL:
>             Project: Nutch
>          Issue Type: Improvement
>          Components: scoring
>            Reporter: Sujen Shah
>            Assignee: Sujen Shah
>              Labels: memex
>             Fix For: 1.13
> This patch would add Lucene based tokenization to the cosine similarity plugin and clean
up the code currently present. 

This message was sent by Atlassian JIRA

View raw message