kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhit Kalsotra <abhit...@gmail.com>
Subject Strange issue in Kafka Windows where Log directory getting increased day by day
Date Sun, 27 Nov 2016 05:44:25 GMT
Dear *

I am facing some issue in Kafka Windows, the Log directories size are keep
on increasing day by day..

Currently the traffic on my kafka set up is minimal , but if this log
directory size does not get fixed then its going to be serious issue...

My Kafka SetUp

   - 2 Windows Server
   - kafka_2.11- and zoo keeper 3.4.9
   - 6 kafka broker nodes running on 2 Windows servers.
   - 2 topics, with 50 partitions and replication factor of 3.
   And one topic retention time is *86400000(24 hours)*, and other one
is *3600000
   (1 Hour)*

But every day I see the log directories are getting increased, where as the
traffic on my Kafka is the constant.

Please let me know what would be the resolution for the same. Also when i
see the Log directories e.g

*C:\kafka_2.11-\kafka_2.11-\xyz-47inside this I
could see 000000000000000000000000.index and000000000000000000000000.log
file existed around 10 days ago date too.*
Please let me know what needs to be done

As other wise its going to a big bottle neck for me

Jira issue *<https://issues.apache.org/jira/browse/KAFKA-1194
If you can't succeed, call it version 1.0

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message