spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Enno Shioji <eshi...@gmail.com>
Subject Re: Twitter4J streaming question
Date Thu, 23 Jul 2015 20:17:20 GMT
You are probably listening to the sample stream, and THEN filtering. This
means you listen to 1% of the twitter stream, and then looking for the
tweet by Bloomberg, so there is a very good chance you don't see the
particular tweet.

In order to get all Bloomberg related tweets, you must connect to twitter
using the filter API and not the sample API:
https://dev.twitter.com/streaming/reference/post/statuses/filter

On Thu, Jul 23, 2015 at 8:23 PM, pjmccarthy <pmccarthy@eatonvance.com>
wrote:

> Hopefully this is an easy one.  I am trying to filter a twitter dstream by
> user ScreenName - my code is as follows
> val stream = TwitterUtils.createStream(ssc, None)
>         .filter(_.getUser.getScreenName.contains("markets"))
>
> however nothing gets returned and I can see that Bloomberg has tweeted.  If
> I remove the filter I get tweets
> If I change the code to looke for engligh or french tweets that works
>
> Is there a better way to do it ?
>
> Can anyone assist ?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Twitter4J-streaming-question-tp23974.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message