kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Yu <guans...@gmail.com>
Subject Re: Log retention not working
Date Thu, 28 Jul 2016 23:43:07 GMT
We did update the default log dirs. So shouldn't be an issue.

On Thu, Jul 28, 2016 at 2:56 PM Samuel Taylor <staylor@square-root.com>
wrote:

> I think the default puts the log directory in /tmp/kafka-logs. It may be
> worth configuring your settings to put your logs somewhere else and seeing
> what happens.
>
> On Thu, Jul 28, 2016 at 10:16 AM, David Yu <guanshan@gmail.com> wrote:
>
> > Those are all with default value. Will continue investigation.
> >
> > On Wed, Jul 27, 2016 at 11:38 PM Manikumar Reddy <
> > manikumar.reddy@gmail.com>
> > wrote:
> >
> > > also check if any value set for log.retention.bytes broker config
> > >
> > > On Wed, Jul 27, 2016 at 8:03 PM, Samuel Taylor <sgt@samueltaylor.org>
> > > wrote:
> > >
> > > > Is it possible that your log directory is in /tmp/ and your OS is
> > > deleting
> > > > that directory? I know it's happened to me before.
> > > >
> > > > - Samuel
> > > >
> > > > On Jul 27, 2016 13:43, "David Yu" <guanshan@gmail.com> wrote:
> > > >
> > > > > We are using Kafka 0.8.2.0 provided by CDH. Our Kafka retention is
> > set
> > > to
> > > > > default 7 days. One problem we have with one of our topics is that,
> > the
> > > > > logs are purged within two days. This topic does not override any
> > > default
> > > > > settings.
> > > > >
> > > > > Just wanna get some pointers as to how to debug this issue.
> > > > >
> > > > > Thanks,
> > > > > David
> > > > >
> > > >
> > >
> >
>
>
>
> --
> *Samuel Taylor*
> Data Science
>
> *Square Root, Inc. <http://square-root.com/>*
> <http://square-root.com/>Square-Root.com <http://square-root.com/>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message