kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From naresh Goud <nareshgoud.du...@gmail.com>
Subject Re: Deleting Kafka consumer offset topic.log files
Date Mon, 01 Oct 2018 21:59:40 GMT
Is this helps?
https://stackoverflow.com/questions/42546501/the-retention-period-for-offset-topic-of-kafka/44277227#44277227



On Mon, Oct 1, 2018 at 2:31 PM Kaushik Nambiar <kaushiknambiar22@gmail.com>
wrote:

> Hello,
> Any updates on the issue?
>
>
> Regards,
> Kaushik Nambiar
>
> On Wed, Sep 26, 2018, 12:37 PM Kaushik Nambiar <kaushiknambiar22@gmail.com
> >
> wrote:
>
> > Hello,
> >
> > I am using an SSL Kafka v 0.11.xx on a Linux operating system.
> >
> > I can see in the log files that the topic segments are getting deleted
> > regularly.
> > The concern I am having is for the system topic which is
> __consumer_offset
> > , the segments are not getting deleted.
> >
> > So that's contributing to a large amount of data getting accumulated on
> > our disks.
> > I can see many sufficiently old  .log files sizing around 100mb each. Due
> > to many such files in the __consumer_offset topic the disk is getting
> maxed
> > out.
> >
> > I had raised similar queries earlier to check if there is a
> > misconfiguration ,but the requests were not processed to completion.
> >
> > So as a quick fix,is it safe to delete the .log files in the
> > __consumer_offset topic?
> > If yes can u tell me how that can be done.
> >
> > If not can u suggest me another fix which can be tried?
> >
> > I have attached my server.properties for reference.
> >
> > Your responses are highly appreciated.
> >
> >
> > Thankyou,
> > Kaushik Nambiar
> >
> >
> >
> >
> >
> >
>
-- 
Thanks,
Naresh
www.linkedin.com/in/naresh-dulam
http://hadoopandspark.blogspot.com/

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message