spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Holden Karau <hol...@pigscanfly.ca>
Subject Re: what does DStream.union() do?
Date Wed, 29 Oct 2014 22:29:23 GMT
The union function simply returns a DStream with the elements from both.
This is the same behavior as when we call union on RDDs :) (You can think
of union as similar to the union operator on sets except without the unique
element restrictions).

On Wed, Oct 29, 2014 at 3:15 PM, spr <spr@yarcdata.com> wrote:

> The documentation at
>
> https://spark.apache.org/docs/1.0.0/api/scala/index.html#org.apache.spark.streaming.dstream.DStream
> describes the union() method as
>
> "Return a new DStream by unifying data of another DStream with this
> DStream."
>
> Can somebody provide a clear definition of what "unifying" means in this
> context?  Does it append corresponding elements together?  Inside a wider
> tuple if need be?
>
> I'm hoping for something clear enough that it could just be added to the
> doc
> page if the developers so chose.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/what-does-DStream-union-do-tp17673.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>


-- 
Cell : 425-233-8271

Mime
View raw message