spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xiangrui Meng <men...@gmail.com>
Subject Re: k-means for text mining in a streaming context
Date Wed, 17 Jun 2015 23:42:37 GMT
Yes. You can apply HashingTF on your input stream and then use
StreamingKMeans for training and prediction. -Xiangrui

On Mon, Jun 8, 2015 at 11:05 AM, Ruslan Dautkhanov <dautkhanov@gmail.com> wrote:
> Hello,
>
> https://spark.apache.org/docs/latest/mllib-feature-extraction.html
> would Feature Extraction and Transformation work in a streaming context?
>
> Wanted to extract text features, build K-means clusters for streaming
> context
> to detect anomalies on a continuous text stream.
>
> Would it be possible?
>
>
> Best reagrds,
> Ruslan Dautkhanov
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message