spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "yuhao yang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-15064) Locale support in StopWordsRemover
Date Tue, 03 May 2016 01:53:12 GMT

    [ https://issues.apache.org/jira/browse/SPARK-15064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267910#comment-15267910
] 

yuhao yang commented on SPARK-15064:
------------------------------------

Yes, something like that, as long as there's different behavior under different Locales. 


> Locale support in StopWordsRemover
> ----------------------------------
>
>                 Key: SPARK-15064
>                 URL: https://issues.apache.org/jira/browse/SPARK-15064
>             Project: Spark
>          Issue Type: New Feature
>          Components: ML
>    Affects Versions: 2.0.0
>            Reporter: Xiangrui Meng
>
> We support case insensitive filtering (default) in StopWordsRemover. However, case insensitive
matching depends on the locale and region, which cannot be explicitly set in StopWordsRemover.
We should consider adding this support in MLlib.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message