spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jianshi Huang <jianshi.hu...@gmail.com>
Subject Re: Which is better? One spark app listening to 10 topics vs. 10 spark apps each listening to 1 topic
Date Mon, 27 Oct 2014 09:19:11 GMT
Any suggestion? :)

Jianshi

On Thu, Oct 23, 2014 at 3:49 PM, Jianshi Huang <jianshi.huang@gmail.com>
wrote:

> The Kafka stream has 10 topics and the data rate is quite high (~ 100K/s
> per topic).
>
> Which configuration do you recommend?
> - 1 Spark app consuming all Kafka topics
> - 10 separate Spark app each consuming one topic
>
> Assuming they have the same resource pool.
>
> Cheers,
> --
> Jianshi Huang
>
> LinkedIn: jianshi
> Twitter: @jshuang
> Github & Blog: http://huangjs.github.com/
>



-- 
Jianshi Huang

LinkedIn: jianshi
Twitter: @jshuang
Github & Blog: http://huangjs.github.com/

Mime
View raw message