nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eyeris Rodriguez Rueda (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (NUTCH-2030) ParseZip plugin is not able to extract language from zip document,this could solve that problem.
Date Wed, 30 Sep 2015 18:21:04 GMT

     [ https://issues.apache.org/jira/browse/NUTCH-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eyeris Rodriguez Rueda updated NUTCH-2030:
------------------------------------------
    Fix Version/s:     (was: 1.11)

> ParseZip plugin is not able to extract language from zip document,this could solve that
problem.
> ------------------------------------------------------------------------------------------------
>
>                 Key: NUTCH-2030
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2030
>             Project: Nutch
>          Issue Type: Improvement
>          Components: parser, plugin
>         Environment: Linux Mint 17 qiana, 4 GB Ram,Core I3.
>            Reporter: Eyeris Rodriguez Rueda
>            Priority: Minor
>   Original Estimate: 336h
>  Remaining Estimate: 336h
>
> Actually parse-zip plugin donĀ“t extract language from zip document, therefore lang field
is empty in solr or elastic. If the package(.zip) contains a list of documents so the lang
field could be multivalued to support that list of languages. A simple change to parse-zip
pluging could fix this problem. I will use Language Identifier class from tika and analyze
each document inside.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message