spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Soumitra Johri <>
Subject inter spark application communication
Date Mon, 18 Apr 2016 19:04:54 GMT

I have two applications : App1 and App2.
On a single cluster I have to spawn 5 instances os App1 and 1 instance of

What would be the best way to send data from the 5 App1 instances to the
single App2 instance ?

Right now I am using Kafka to send data from one spark application to the
spark application  but the setup doesn't seem right and I hope there is a
better way to do this.

Warm Regards

View raw message