nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eyeris Rodriguez Rueda (JIRA)" <j...@apache.org>
Subject [jira] [Created] (NUTCH-2030) ParseZip plugin is not able to extract language from zip document,this could solve that problem.
Date Tue, 02 Jun 2015 13:19:18 GMT
Eyeris Rodriguez Rueda created NUTCH-2030:
---------------------------------------------

             Summary: ParseZip plugin is not able to extract language from zip document,this
could solve that problem.
                 Key: NUTCH-2030
                 URL: https://issues.apache.org/jira/browse/NUTCH-2030
             Project: Nutch
          Issue Type: Improvement
          Components: parser, plugin
         Environment: Linux Mint 17 qiana, 4 GB Ram,Core I3.
            Reporter: Eyeris Rodriguez Rueda
            Priority: Minor
             Fix For: 1.11, 2.3.1


Actually parse-zip plugin donĀ“t extract language from zip document, therefore lang field
is empty in solr or elastic. If the package(.zip) contains a list of documents so the lang
field could be multivalued to support that list of languages. A simple change to parse-zip
pluging could fix this problem. I will use Language Identifier class from tika and analyze
each document inside.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message