spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrés Ivaldi <iaiva...@gmail.com>
Subject Re: Multiple Spark taks with Akka FSM
Date Wed, 09 Mar 2016 16:50:44 GMT
My Mistake, It's not Akka FSM is Akka Flow Graphs


On Wed, Mar 9, 2016 at 1:46 PM, Andrés Ivaldi <iaivaldi@gmail.com> wrote:

> Hello,
>
> I'd like to know if this architecture is correct or not. We are studying
> Spark as our ETL engine, we have a UI designer for the graph, this give us
> a model that we want to translate in the corresponding Spark executions.
> What brings to us Akka FSM, Using same sparkContext for all actors, we
> suppose that parallelism will be supported by Spark(depending on
> configuration of course) and Akka, each node Actor will be executed only if
> his related in edges are completed.
> It's that correct or there is any simple way to do it? I took a look to
> Graphx but It's looks like is more for joins than manipulation or maybe
> I've overlook something
>
> regards
> --
> Ing. Ivaldi Andres
>



-- 
Ing. Ivaldi Andres

Mime
View raw message