spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Compton <compton.r...@gmail.com>
Subject Re: filtering out non English tweets using TwitterUtils
Date Wed, 12 Nov 2014 05:52:51 GMT
Fwiw if you do decide to handle language detection on your machine this
library works great on tweets https://github.com/carrotsearch/langid-java

On Tue, Nov 11, 2014, 7:52 PM Tobias Pfeiffer <tgp@preferred.jp> wrote:

> Hi,
>
> On Wed, Nov 12, 2014 at 5:42 AM, SK <skrishna.id@gmail.com> wrote:
>>
>> But getLang() is one of the methods of twitter4j.Status since version
>> 3.0.6
>> according to the doc at:
>>    http://twitter4j.org/javadoc/twitter4j/Status.html#getLang--
>>
>> What version of twitter4j does Spark Streaming use?
>>
>
> 3.0.3
> https://github.com/apache/spark/blob/master/external/twitter/pom.xml#L53
>
> Tobias
>
>

Mime
View raw message