kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From CuiLiang <cuilian...@gmail.com>
Subject Re: Kafka 0.8 delete log failed
Date Wed, 11 Dec 2013 08:30:22 GMT
Update this issue.
I update the log config to log.dirs=\\kafka-logs. The log file is deleted
but still can't delete the index file. I got below error message.

[2013-12-11 00:07:59,671] INFO Deleting index
d:\kafka-logs\test001-0\00000000000000507600.index (kafka.log.OffsetIndex)
[2013-12-11 00:07:59,672] ERROR error in loggedRunnable (kafka.utils.Utils$)
kafka.common.KafkaStorageException: Deleting log segment 507600 failed.
at kafka.log.Log$$anonfun$deleteSegments$1.apply(Log.scala:613)
at kafka.log.Log$$anonfun$deleteSegments$1.apply(Log.scala:608)
at
scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
at kafka.log.Log.deleteSegments(Log.scala:608)
at
kafka.log.LogManager.kafka$log$LogManager$$cleanupSegmentsToMaintainSize(LogManager.scala:264)
at kafka.log.LogManager$$anonfun$cleanupLogs$2.apply(LogManager.scala:277)
at kafka.log.LogManager$$anonfun$cleanupLogs$2.apply(LogManager.scala:275)
at scala.collection.Iterator$class.foreach(Iterator.scala:631)
at
scala.collection.JavaConversions$JIteratorWrapper.foreach(JavaConversions.scala:474)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:79)
at
scala.collection.JavaConversions$JListWrapper.foreach(JavaConversions.scala:521)
at kafka.log.LogManager.cleanupLogs(LogManager.scala:275)
at
kafka.log.LogManager$$anonfun$startup$1.apply$mcV$sp(LogManager.scala:141)
at kafka.utils.Utils$$anon$2.run(Utils.scala:68)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRunAndReset(Unknown Source)
at java.util.concurrent.FutureTask.runAndReset(Unknown Source)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(Unknown
Source)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown
Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)

Thanks,
Liang Cui


2013/12/11 CuiLiang <cuiliang05@gmail.com>

> The Kafka folder is d:\kafka_2.8.0-0.8.0. Kafka log folder is
> d:\data\kafka-logs. kafka batch folder is d:\kafka_2.8.0-0.8.0\bin.
> log.dirs=..\\..\\data\\kafka-logs
> The log segments files is created correct, but can't delete the log file.
> My machine has C, D, E,F, G, k partitions.
>
>
> Thanks,
> Liang Cui
>
>
> 2013/12/11 Jay Kreps <jay.kreps@gmail.com>
>
>> What is your configuration for data.dirs (the path where data is) and what
>> is the set of disks/volumes on the machine?
>>
>> -Jay
>>
>>
>> On Tue, Dec 10, 2013 at 12:50 AM, CuiLiang <cuiliang05@gmail.com> wrote:
>>
>> > Hi All,
>> >
>> > I'm use Kafka 0.8 release build with 1 partition, 1 replica. My OS is
>> > Windows server 2012 and JDK is 1.7. I got below error when Kafka delete
>> > logs. Any guidance would be of great help.
>> >
>> > [2013-12-09 04:00:10,525] ERROR error in loggedRunnable
>> > (kafka.utils.Utils$)kafka.common.KafkaStorageException: Deleting log
>> > segment 140332200 failed. at
>> > kafka.log.Log$$anonfun$deleteSegments$1.apply(Log.scala:613) at
>> > kafka.log.Log$$anonfun$deleteSegments$1.apply(Log.scala:608) at
>> >
>> >
>> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
>> > at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:32)
>> at
>> > kafka.log.Log.deleteSegments(Log.scala:608) at
>> >
>> >
>> kafka.log.LogManager.kafka$log$LogManager$$cleanupExpiredSegments(LogManager.scala:242)
>> > at
>> kafka.log.LogManager$$anonfun$cleanupLogs$2.apply(LogManager.scala:277)
>> > at
>> kafka.log.LogManager$$anonfun$cleanupLogs$2.apply(LogManager.scala:275)
>> > at scala.collection.Iterator$class.foreach(Iterator.scala:631) at
>> >
>> >
>> scala.collection.JavaConversions$JIteratorWrapper.foreach(JavaConversions.scala:474)
>> > at scala.collection.IterableLike$class.foreach(IterableLike.scala:79) at
>> >
>> >
>> scala.collection.JavaConversions$JListWrapper.foreach(JavaConversions.scala:521)
>> > at kafka.log.LogManager.cleanupLogs(LogManager.scala:275) at
>> >
>> kafka.log.LogManager$$anonfun$startup$1.apply$mcV$sp(LogManager.scala:141)
>> > at kafka.utils.Utils$$anon$2.run(Utils.scala:68) at
>> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> at
>> > java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at
>> >
>> >
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
>> > at
>> >
>> >
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>> > at
>> >
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> > at
>> >
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> > at java.lang.Thread.run(Thread.java:744)
>> >
>> >
>> >
>> > --
>> > Thanks,
>> > Liang Cui
>> >
>>
>
>
>
> --
> cuiliang
> MSN : bypp1314@hotmail.com
>



-- 
cuiliang
MSN : bypp1314@hotmail.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message