kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Cory Watson <gp...@keen.io>
Subject Interaction of retention settings for broker and topic plus partitions
Date Thu, 18 Sep 2014 21:55:48 GMT
Hello all!

I'm curious about the interaction of server and topic level retention
settings. It's not clear to me the precedence of the follow:

   - broker's default log.retention.bytes
   - topic's retention.bytes (which defaults to broker's
   log.retention.bytes)
   - broker's log.retention.hours and log.retention.minutes (if both are
   specified then it seems to be the lower of the two, since it's when
   "either" is exceeded)

It seems that the rule is that when any of these are violated then the log
segment is deleted. Is this right?

Also, just to be clear: The log sizes in questions are for a single
partitions logs?

I have a situation where my per-topic retention.bytes is very high, but my
default log.retention.hours is lower (the default @ 168 hours). It seems
that it's truncating at the log.retention.hours instead of the topic's
retention.bytes.

Am I understanding this correctly? :)

-- 
Cory Watson
Principal Infrastructure Engineer // Keen IO

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message