spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: Support for cycles in spark streaming topology ?????
Date Thu, 02 Apr 2015 13:27:38 GMT
You can have diamonds but not cycles in the dependency graph.

But what you are describing really sounds like simple iteration, since
presumably you mean that the state of each element in the 'cycle'
changes each time, and so isn't really the same element each time, and
eventually you decide to stop. That is quite possible.


On Thu, Apr 2, 2015 at 12:53 PM, anshu shukla <anshushukla0@gmail.com> wrote:
> I  didn't  find any documentation  regarding support for  cycles in spark
> topology , although storm supports  this using manual  configuration in
> acker function logic (setting it to a particular count) .By cycles  i
>  doesn't mean infinite loops .
>
> Can any body please help me in that .
>
> --
> Thanks & Regards,
> Anshu Shukla

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message