spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joseph Bradley <jos...@databricks.com>
Subject Re: HashingTFModel/IDFModel in Structured Streaming
Date Fri, 20 Oct 2017 18:01:33 GMT
Hi Davis,
We've started tracking these issues under this umbrella:
https://issues.apache.org/jira/browse/SPARK-21926
I'm hoping we can fix some of these for 2.3.
Thanks,
Joseph

On Mon, Oct 16, 2017 at 9:23 PM, Davis Varghese <verghesd@gmail.com> wrote:

>  I have built a ML pipeline model on a static twitter data for sentiment
> analysis. When I use the model on a structured stream, it always throws
> "Queries with streaming sources must be executed with writeStream.start()".
> This particular model doesn't contain any documented "unsupported"
> operations. It only calls the transform() method of the stages. Anyone have
> encountered the issue? if the model doesn't contain
> HashingTFModel/IDFModel,
> it works fine, but then I can not create feature vectors from the tweet.
>
> Thanks,
> Davis
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>


-- 

Joseph Bradley

Software Engineer - Machine Learning

Databricks, Inc.

[image: http://databricks.com] <http://databricks.com/>

Mime
View raw message