kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: questtion about log.retention.bytes
Date Sat, 17 Aug 2013 04:40:21 GMT
log.retention.bytes is for all topics that are not included in
log.retention.bytes.per.topic
(which defines a map of topic -> size).

Currently, we don't have a total size limit across all topics.

Thanks,

Jun


On Fri, Aug 16, 2013 at 2:00 PM, Paul Christian
<pchristian@salesforce.com>wrote:

> According to the Kafka 8 documentation under broker configuration. There
> are these parameters and their definitions.
>
> log.retention.bytes -1 The maximum size of the log before deleting it
> log.retention.bytes.per.topic "" The maximum size of the log for some
> specific topic before deleting it
>
> I'm curious what the first value 'log.retention.bytes' is for if the second
> one is for per topic logs, because aren't all logs generated per topic? Is
> this an aggregate value across topics?
>
> Related question, is there a parameter for kafka where you can say only
> hold this much TOTAL data across all topic ( logs/index together )? I.e.
> our  hosts have this much available space and so value
> log.retention.whatever.aggregate == 75% total  disk space.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message