kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Boris Tyukin <bo...@boristyukin.com>
Subject clarification on Partitioning Guidelines and CPU cores
Date Wed, 10 Oct 2018 21:02:54 GMT
Hi all,

can someone clarify if this recommendation below - does it mean physical or
hyper-threaded CPU cores? quite a big difference...
Thanks,
Boris

Partitioning Guidelines (https://kudu.apache.org/docs/
kudu_impala_integration.html#partitioning_rules_of_thumb)
- For large tables, such as fact tables, aim for as many tablets as you
have cores in the cluster.
- For small tables, such as dimension tables, aim for a large enough number
of tablets that each tablet is at least 1 GB in size.

In general, be mindful the number of tablets limits the parallelism of
reads, in the current implementation. Increasing the number of tablets
significantly beyond the number of cores is likely to have diminishing
returns.

Mime
View raw message