spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: concat two Dstreams
Date Wed, 12 Nov 2014 04:01:32 GMT
Concatenate? no. It doesn't make sense in this context to think about one
potentially infinite stream coming after another one. Do you just want the
union of batches from two streams? yes, just union(). You can union() with
non-streaming RDDs too.

On Tue, Nov 11, 2014 at 10:41 PM, Josh J <joshjdevl@gmail.com> wrote:

> Hi,
>
> Is it possible to concatenate or append two Dstreams together? I have an
> incoming stream that I wish to combine with data that's generated by a
> utility. I then need to process the combined Dstream.
>
> Thanks,
> Josh
>

Mime
View raw message