kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harper Henn <harper.h...@datto.com>
Subject Re: Kafka data log retention policy for topics
Date Wed, 12 Dec 2018 17:41:35 GMT
You can configure a different retention policy that overrides the global
one in server.properties when you create or alter a topic. Here's an
example:

bin/kafka-topics.sh --create --zookeeper localhost:2181 --topic some-topic
--partitions 1 --replication-factor 1 --config retention.ms=172800000

On Wed, Dec 12, 2018 at 6:28 AM Parth Gandhi <
parth.gandhi@excellenceinfonet.com> wrote:

> All,
>
> We can set the retention policy for kafka logs from the server.properties
> which will be applied to all the topic by default. However is there a way
> to set up the different log retention policy for different topics?
>
> Also does kafka record the message in time  while storing the message as
> log? I randomly checked few logs and did not see it. Below is a screen
> capture of one of my partition. What are these NULL values?
>
> [image: image.png]
>
> Thanks,
> Parth Gandhi
> DevOps
>
>
> *Disclaimer*
>
> The information contained in this communication from the sender is
> confidential. It is intended solely for use by the recipient and others
> authorized to receive it. If you are not the recipient, you are hereby
> notified that any disclosure, copying, distribution or taking action in
> relation of the contents of this information is strictly prohibited and may
> be unlawful.
>
> This email has been scanned for viruses and malware, and may have been
> automatically archived by *Mimecast Ltd*, an innovator in Software as a
> Service (SaaS) for business. Providing a *safer* and *more useful* place
> for your human generated data. Specializing in; Security, archiving and
> compliance. To find out more Click Here
> <http://www.mimecast.com/products/>.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message