cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcus Eriksson (Jira)" <j...@apache.org>
Subject [jira] [Updated] (CASSANDRA-16782) Improve the way we pick sstables for STCS-in-L0 and in TWCS 'current' window
Date Thu, 01 Jul 2021 14:47:00 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-16782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marcus Eriksson updated CASSANDRA-16782:
----------------------------------------
    Test and Documentation Plan: cci run
                         Status: Patch Available  (was: Open)

This patch collects smallest sstables until the total size is 1GB or we reach 1000 sstables
(both configurable), and compacts them together. Once we can't do any compactions like that
(say the 4 smallest sstables size is > 1GB) we start doing L0 -> L1 compactions instead,
this avoids creating huge sstables in L0.
 
With TWCS we take the same approach, but once we can't do any more compactions like that we
do regular STCS
 
[https://github.com/krummas/cassandra/commits/marcuse/16782]
[https://app.circleci.com/pipelines/github/krummas/cassandra?branch=marcuse%2F16782] 

> Improve the way we pick sstables for STCS-in-L0 and in TWCS 'current' window
> ----------------------------------------------------------------------------
>
>                 Key: CASSANDRA-16782
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-16782
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Local/Compaction/LCS, Local/Compaction/TWCS
>            Reporter: Marcus Eriksson
>            Assignee: Marcus Eriksson
>            Priority: Normal
>             Fix For: 4.x
>
>
> The goal when being behind in L0 should always be to get the number of sstables down
to a reasonable level as soon as possible. Currently it is common that we run compactions
on the large sstables but leave thousands of tiny sstables behind.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org


Mime
View raw message