spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Santokh Singh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-26829) In place standard scaler so the column remains same after transformation
Date Wed, 13 Feb 2019 18:34:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-26829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767439#comment-16767439
] 

Santokh Singh commented on SPARK-26829:
---------------------------------------

Yes, you are right, there are workarounds that I had to do to preserve the schema, but such
an option would have really made it very easy and won't need any of work to go to original
schema.

> In place standard scaler so the column remains same after transformation
> ------------------------------------------------------------------------
>
>                 Key: SPARK-26829
>                 URL: https://issues.apache.org/jira/browse/SPARK-26829
>             Project: Spark
>          Issue Type: Improvement
>          Components: ML
>    Affects Versions: 2.3.2
>            Reporter: Santokh Singh
>            Priority: Major
>
> Standard scaler and some similar transformations takes input column name and produce
a new column, either accepting output column or generating new one with some random name after
performing transformation.
>  "inplace" flag  on true does not generate new column in output in dataframe after
transformation; preserves schema of df.
> "inplace" flag on false works the way its currently working.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message