spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From motte1988 <>
Subject basic streaming question
Date Fri, 19 Sep 2014 07:35:22 GMT
Hello everybody,
I'm new to spark streaming and played a bit around with WordCount and a
PageRank-Algorithm in a cluster-environment.  
Am I right, that in the cluster each executor computes data stream
separately? And that the result of each executor is independent of the other
In the "non-streaming" spark applications each action-operation merges the
data from the executors and compute one result. or is this wrong?
Is it possible in streaming-context to merge several streams like in a
reduce and compute one result?


View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message