tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris A. Mattmann (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (TIKA-1549) Two times speed increase of language profile distance calculation
Date Sat, 14 Feb 2015 07:51:12 GMT

    [ https://issues.apache.org/jira/browse/TIKA-1549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321287#comment-14321287
] 

Chris A. Mattmann edited comment on TIKA-1549 at 2/14/15 7:50 AM:
------------------------------------------------------------------

Patch applied to close #29 on Github in r1659759. Thanks [~toke] appreciate it!


was (Author: chrismattmann):
Patch applied to close #29 on Github in r1659759. Thanks [~eto] appreciate it!

> Two times speed increase of language profile distance calculation
> -----------------------------------------------------------------
>
>                 Key: TIKA-1549
>                 URL: https://issues.apache.org/jira/browse/TIKA-1549
>             Project: Tika
>          Issue Type: Bug
>          Components: languageidentifier
>            Reporter: Toke Eskildsen
>            Assignee: Chris A. Mattmann
>             Fix For: 1.8
>
>
> The distance calculation for language profiles creates a Set of Strings with each call
and performs hashtable lookups for all those Strings. This patch creates and caches compact
structures that are iterated sequentially. The result is a factor 2 speed up (see the performance
test in LanguageIdentifierTest).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message