spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jianshi Huang <jianshi.hu...@gmail.com>
Subject Which is better? One spark app listening to 10 topics vs. 10 spark apps each listening to 1 topic
Date Thu, 23 Oct 2014 07:49:47 GMT
The Kafka stream has 10 topics and the data rate is quite high (~ 100K/s
per topic).

Which configuration do you recommend?
- 1 Spark app consuming all Kafka topics
- 10 separate Spark app each consuming one topic

Assuming they have the same resource pool.

Cheers,
-- 
Jianshi Huang

LinkedIn: jianshi
Twitter: @jshuang
Github & Blog: http://huangjs.github.com/

Mime
View raw message