spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Russell Jurney <>
Subject Spark ML DataFrame API - need cosine similarity, how to convert to RDD Vectors?
Date Tue, 15 Nov 2016 18:06:10 GMT
I have two dataframes with common feature vectors and I need to get the
cosine similarity of one against the other. It looks like this is possible
in the RDD based API, mllib, but not in ml.

So, how do I convert my sparse dataframe vectors into something spark mllib
can use? I've searched, but haven't found anything.

Russell Jurney

View raw message