nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lewis John McGibbney (JIRA)" <>
Subject [jira] [Commented] (NUTCH-1397) language-identifier incorrectly handles double-barreled language properties
Date Fri, 15 Jun 2012 16:11:43 GMT


Lewis John McGibbney commented on NUTCH-1397:

Aye Julien. I was just this minute looking through the open Tika issues surrounding language-detection
and yeah I understand exactly where you're coming from. In all honesty this was not a biggie
for me, I was just aware of the fact that something wasn't right w.r.t the double-barreled
scenario. I suppose if you were faceting by specific language e.g. en-GB en-US then it would
be handy but for the run of the mill facet search it is required on a minimal basis (I assume).
I suppose we can keep it open here in Nutch and as you mention if someone wishes (or I get
round to it) then the patch would fit into the parsing code on this side.
> language-identifier incorrectly handles double-barreled language properties
> ---------------------------------------------------------------------------
>                 Key: NUTCH-1397
>                 URL:
>             Project: Nutch
>          Issue Type: Improvement
>          Components: parser
>    Affects Versions: nutchgora, 1.5
>            Reporter: Lewis John McGibbney
>            Priority: Minor
>             Fix For: 1.6, 2.1
> Currently when language-identifier is activated is parses and identifies langauge-type=en,
however does not identify en-GB or en-US. This issues should correct that. 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:!default.jspa
For more information on JIRA, see:


View raw message