spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From forough <foroughi.foro...@gmail.com>
Subject deterministic D-Stream mode
Date Sat, 01 Nov 2014 08:53:11 GMT
Hi all, 
I have 2 questions:

1. I found out the meaning of "deterministic" in D-Stream model is :
given a particular input, will always produce the same output that is
necessary for recomputation in lineage.
Is it right? 

2. Why spark stream needs to replicate input data for making deterministic
state? what is the relation between deterministic tasks or operations and
replication?

Thanks.



--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/deterministic-D-Stream-mode-tp9054.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message