kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kaushik Nambiar <kaushiknambia...@gmail.com>
Subject Re: Deleting Kafka consumer offset topic.log files
Date Mon, 01 Oct 2018 19:31:23 GMT
Hello,
Any updates on the issue?


Regards,
Kaushik Nambiar

On Wed, Sep 26, 2018, 12:37 PM Kaushik Nambiar <kaushiknambiar22@gmail.com>
wrote:

> Hello,
>
> I am using an SSL Kafka v 0.11.xx on a Linux operating system.
>
> I can see in the log files that the topic segments are getting deleted
> regularly.
> The concern I am having is for the system topic which is __consumer_offset
> , the segments are not getting deleted.
>
> So that's contributing to a large amount of data getting accumulated on
> our disks.
> I can see many sufficiently old  .log files sizing around 100mb each. Due
> to many such files in the __consumer_offset topic the disk is getting maxed
> out.
>
> I had raised similar queries earlier to check if there is a
> misconfiguration ,but the requests were not processed to completion.
>
> So as a quick fix,is it safe to delete the .log files in the
> __consumer_offset topic?
> If yes can u tell me how that can be done.
>
> If not can u suggest me another fix which can be tried?
>
> I have attached my server.properties for reference.
>
> Your responses are highly appreciated.
>
>
> Thankyou,
> Kaushik Nambiar
>
>
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message