spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From davideanastasia <>
Subject ML Transformer: create feature that uses multiple columns
Date Sat, 09 Dec 2017 11:41:31 GMT
I am trying to write a custom ml.Transformer. It's a very simple row-by-row
transformation, but it takes in account multiple columns of the DataFrame
(and sometimes, interaction between columns).

I was wondering what the best way to achieve this is. I have used a udf in
the Transformer before, but that only allows me to use one column (am I
right?). How can I use multiple columns?


Sent from:

To unsubscribe e-mail:

View raw message