spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michal Čizmazia <mici...@gmail.com>
Subject Re: How do I Process Streams that span multiple lines?
Date Mon, 03 Aug 2015 18:53:49 GMT
Sorry.

SparkContext.wholeTextFiles

Not sure about streams.

On 3 August 2015 at 14:50, Michal Čizmazia <micizma@gmail.com> wrote:

> Are you looking for RDD.wholeTextFiles?
>
> On 3 August 2015 at 10:57, Spark Enthusiast <sparkenthusiast@yahoo.in>
> wrote:
>
>> All  examples of Spark Stream programming that I see assume streams of
>> lines that are then tokenised and acted upon (like the WordCount example).
>>
>> How do I process Streams that span multiple lines? Are there examples
>> that I can use?
>>
>
>

Mime
View raw message