tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jan Høydahl (JIRA) <j...@apache.org>
Subject [jira] [Commented] (TIKA-546) Add ability to create language profiles to tika-app
Date Sat, 17 Sep 2011 23:26:09 GMT

    [ https://issues.apache.org/jira/browse/TIKA-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13107290#comment-13107290
] 

Jan Høydahl commented on TIKA-546:
----------------------------------

What's the state of this issue? It says "unresolved" but something is committed?

> Add ability to create language profiles to tika-app
> ---------------------------------------------------
>
>                 Key: TIKA-546
>                 URL: https://issues.apache.org/jira/browse/TIKA-546
>             Project: Tika
>          Issue Type: New Feature
>          Components: cli, languageidentifier
>    Affects Versions: 0.7
>            Reporter: Jan Høydahl
>            Assignee: Chris A. Mattmann
>         Attachments: TIKA-546.tikhonov.18042011.PATCH
>
>
> Since TIKA-490 it is supposed to be easy adding new language profiles to TIKA. However,
currently the process involves using Nutch's NGramProfile tool and editing the output.
> We should port Nutch's profile builder to Tika and make it part of tika-app.jar:
> # See http://wiki.apache.org/nutch/LanguageIdentifier
> # java -jar tika-app.jar --create-profile [--gramsizes=<n>,<n>,...] [--maxlines=<max>]
<profile-name> <filename> <encoding>
> Using --gramsizes and --maxlines, we could support both Tika-style profiles and Nutch-style
profiles and thus deprecate the Nutch tool. Defaults should be --gramsizes=3 --maxlines=1000

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       

Mime
View raw message