kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tao xiao <xiaotao...@gmail.com>
Subject Re: Amount of partitions
Date Fri, 04 Sep 2015 15:11:54 GMT
Here is a good doc to describe how to choose the right number of partitions

http://www.confluent.io/blog/how-to-choose-the-number-of-topicspartitions-in-a-kafka-cluster/

On Fri, Sep 4, 2015 at 10:08 PM, Jörg Wagner <joerg.wagner1@1und1.de> wrote:

> Hello!
>
> Regarding the recommended amount of partitions I am a bit confused.
> Basically I got the impression that it's better to have lots of partitions
> (see information from linkedin etc). On the other hand, a lot of
> performance benchmarks floating around show only a few partitions are being
> used.
>
> Especially when considering the difference between hdd and ssds and also
> the amount thereof, what is the way to go?
>
> In my case, I seem to have the best stability and performance issues with
> few partitions *per hdd*, and only one io thread per disk.
>
> What are your experiences and recommendations?
>
> Cheers
> Jörg
>



-- 
Regards,
Tao

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message