spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick McCarthy <PMcCar...@EatonVance.Com>
Subject Re: Twitter4J streaming question
Date Thu, 23 Jul 2015 20:26:42 GMT
How can I tell if it's the sample stream or full stream ?

Sent from my iPhone

On Jul 23, 2015, at 4:17 PM, Enno Shioji <<>>

You are probably listening to the sample stream, and THEN filtering. This means you listen
to 1% of the twitter stream, and then looking for the tweet by Bloomberg, so there is a very
good chance you don't see the particular tweet.

In order to get all Bloomberg related tweets, you must connect to twitter using the filter
API and not the sample API:

On Thu, Jul 23, 2015 at 8:23 PM, pjmccarthy <<>>
Hopefully this is an easy one.  I am trying to filter a twitter dstream by
user ScreenName - my code is as follows
val stream = TwitterUtils.createStream(ssc, None)

however nothing gets returned and I can see that Bloomberg has tweeted.  If
I remove the filter I get tweets
If I change the code to looke for engligh or french tweets that works

Is there a better way to do it ?

Can anyone assist ?

View this message in context:
Sent from the Apache Spark User List mailing list archive at<>.

To unsubscribe, e-mail:<>
For additional commands, e-mail:<>

View raw message