spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Enno Shioji <eshi...@gmail.com>
Subject Re: Twitter4J streaming question
Date Thu, 23 Jul 2015 20:29:43 GMT
You need to pay a lot of money to get the full stream, so unless you are
doing that, it's the sample stream!

On Thu, Jul 23, 2015 at 9:26 PM, Patrick McCarthy <PMcCarthy@eatonvance.com>
wrote:

>  How can I tell if it's the sample stream or full stream ?
> Thanks
>
> Sent from my iPhone
>
> On Jul 23, 2015, at 4:17 PM, Enno Shioji <eshioji@gmail.com> wrote:
>
>   You are probably listening to the sample stream, and THEN filtering.
> This means you listen to 1% of the twitter stream, and then looking for the
> tweet by Bloomberg, so there is a very good chance you don't see the
> particular tweet.
>
>  In order to get all Bloomberg related tweets, you must connect to
> twitter using the filter API and not the sample API:
> https://dev.twitter.com/streaming/reference/post/statuses/filter
>
> On Thu, Jul 23, 2015 at 8:23 PM, pjmccarthy <pmccarthy@eatonvance.com>
> wrote:
>
>> Hopefully this is an easy one.  I am trying to filter a twitter dstream by
>> user ScreenName - my code is as follows
>> val stream = TwitterUtils.createStream(ssc, None)
>>         .filter(_.getUser.getScreenName.contains("markets"))
>>
>> however nothing gets returned and I can see that Bloomberg has tweeted.
>> If
>> I remove the filter I get tweets
>> If I change the code to looke for engligh or french tweets that works
>>
>> Is there a better way to do it ?
>>
>> Can anyone assist ?
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Twitter4J-streaming-question-tp23974.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>

Mime
View raw message