spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From forough <>
Subject deterministic D-Stream mode
Date Sat, 01 Nov 2014 08:53:11 GMT
Hi all, 
I have 2 questions:

1. I found out the meaning of "deterministic" in D-Stream model is :
given a particular input, will always produce the same output that is
necessary for recomputation in lineage.
Is it right? 

2. Why spark stream needs to replicate input data for making deterministic
state? what is the relation between deterministic tasks or operations and


View this message in context:
Sent from the Apache Spark Developers List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message