spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Pruitt <bpru...@opentext.com.INVALID>
Subject Re: [EXTERNAL] - Re: Spark ML / ALS question
Date Thu, 03 Dec 2020 13:22:18 GMT
Thanks, I confused myself.  I was looking at org.apache.spark.ml.recommendation.ALS Javadoc.
 Not sure why it shows up.   I didn't notice the Developer API tag, so "fit" it is!

-S
________________________________
From: Sean Owen <srowen@gmail.com>
Sent: Wednesday, December 2, 2020 3:51 PM
To: Steve Pruitt <bpruitt@opentext.com.invalid>
Cc: user@spark.apache.org <user@spark.apache.org>
Subject: [EXTERNAL] - Re: Spark ML / ALS question

There is only a fit() method in spark.ml<https://urldefense.com/v3/__http://spark.ml__;!!Obbck6kTJA!LtadpPpSINZQ3q4vJOXQw0UmOzZShpk98OlNRZWI2LNAXfqDlnNvNbbKRr3kOTt7$>'s
ALS
http://spark.apache.org/docs/latest/api/scala/org/apache/spark/ml/recommendation/ALS.html<https://urldefense.com/v3/__http://spark.apache.org/docs/latest/api/scala/org/apache/spark/ml/recommendation/ALS.html__;!!Obbck6kTJA!LtadpPpSINZQ3q4vJOXQw0UmOzZShpk98OlNRZWI2LNAXfqDlnNvNbbKRgVXjH-W$>

The older spark.mllib interface has a train() method. You'd generally use the spark.ml<https://urldefense.com/v3/__http://spark.ml__;!!Obbck6kTJA!LtadpPpSINZQ3q4vJOXQw0UmOzZShpk98OlNRZWI2LNAXfqDlnNvNbbKRr3kOTt7$>
version.

On Wed, Dec 2, 2020 at 2:13 PM Steve Pruitt <bpruitt@opentext.com.invalid> wrote:
I am having a little difficulty finding information on the ALS train(…) method in spark.ml<https://urldefense.com/v3/__http://spark.ml__;!!Obbck6kTJA!LtadpPpSINZQ3q4vJOXQw0UmOzZShpk98OlNRZWI2LNAXfqDlnNvNbbKRr3kOTt7$>.
 Its unclear when to use it.  In the java doc, the parameters are undocumented.

What is difference between train(..) and fit(..).  When would do you use one or the other?


-S


Mime
View raw message