lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marco Remy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-11774) langid.map.individual won't work with langid.map.keepOrig
Date Tue, 19 Dec 2017 11:22:00 GMT

    [ https://issues.apache.org/jira/browse/SOLR-11774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296643#comment-16296643
] 

Marco Remy commented on SOLR-11774:
-----------------------------------

I found a workaround for this:

{code:xml}
<copyField source="title_*" dest="title"/>
<copyField source="author_*" dest="author"/>
{code}

Added copyField configuration to the schema, which copies the data back to the original field.


> langid.map.individual won't work with langid.map.keepOrig
> ---------------------------------------------------------
>
>                 Key: SOLR-11774
>                 URL: https://issues.apache.org/jira/browse/SOLR-11774
>             Project: Solr
>          Issue Type: Bug
>      Security Level: Public(Default Security Level. Issues are Public) 
>          Components: contrib - LangId
>    Affects Versions: 6.5
>            Reporter: Marco Remy
>            Priority: Minor
>
> Tried to get language detection to work.
> *Setting:*
> {code:xml}
> <processor class="org.apache.solr.update.processor.LangDetectLanguageIdentifierUpdateProcessorFactory">
>       <str name="langid.fl">title,author</str>
>       <str name="langid.langsField">detected_languages</str>
>       <str name="langid.whitelist">de,en</str>
>       <str name="langid.fallback">txt</str>
>       <bool name="langid.map">true</bool>
>       <bool name="langid.map.individual">true</bool>
>       <bool name="langid.map.keepOrig">true</bool>
>     </processor>
> {code}
> Main purpose
> * Map fields individually
> * Keep the original field
> But the fields won't be mapped individually. They are mapped to a single detected language.
After some hours of investigation i finally found the reason: *The option langid.map.keepOrig
breaks the individual mapping function.* Only if it is disabled the fields will be mapped
as expected.
> - Regards



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message