spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Segel <msegel_had...@hotmail.com>
Subject Re: inter spark application communication
Date Mon, 18 Apr 2016 19:54:01 GMT
have you thought about Akka? 

What are you trying to send? Why do you want them to talk to one another? 

> On Apr 18, 2016, at 12:04 PM, Soumitra Johri <soumitra.siddharth@gmail.com> wrote:
> 
> Hi,
> 
> I have two applications : App1 and App2. 
> On a single cluster I have to spawn 5 instances os App1 and 1 instance of App2.
> 
> What would be the best way to send data from the 5 App1 instances to the single App2
instance ?
> 
> Right now I am using Kafka to send data from one spark application to the spark application
 but the setup doesn't seem right and I hope there is a better way to do this.
> 
> Warm Regards
> Soumitra


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message