spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Pengcheng Luo <pch...@gmail.com>
Subject Re: use CrossValidatorModel for prediction
Date Sun, 02 Oct 2016 15:04:12 GMT


> On Oct 2, 2016, at 1:04 AM, Pengcheng <pchluo@gmail.com> wrote:
> 
> Dear Spark Users,
> 
> I was wondering.
> 
> I have a trained crossvalidator model  
> model: CrossValidatorModel
> 
> I wan to predict a score for  features: RDD[Features]
> 
> Right now I have to convert features to dataframe and then perform predictions as following:
> 
> """
>     val sqlContext = new SQLContext(features.context)
>     val input: DataFrame = sqlContext.createDataFrame(features.map(x => (Vectors.dense(x.getArray),1.0)
)).toDF("features", "label")
>     model.transform(input)
> """
> 
> i wonder If there is any API I can use to performance prediction on each individual Features
> 
> For example, features.map( x => model.predict(x) ) 
> 
> 
> 
> a big thank you!
> 
> peter
> 

Mime
View raw message