spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: Prediction using Classification with text attributes in Apache Spark MLLib
Date Tue, 24 Jun 2014 12:08:35 GMT
On Tue, Jun 24, 2014 at 12:28 PM, Ulanov, Alexander
<alexander.ulanov@hp.com> wrote:
> You need to convert your text to vector space model: http://en.wikipedia.org/wiki/Vector_space_model
> and then pass it to SVM. As far as I know, in previous versions of MLlib there was a
special class for doing this: https://github.com/amplab/MLI/blob/master/src/main/scala/feat/NGrams.scala.
It is not compatible with Spark 1.0.
> I wonder why MLLib folks didn't include it in newer versions of Spark.

(PS that is a class from MLI, not MLlib)

Mime
View raw message