kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Exceptions on broker console
Date Tue, 24 Apr 2012 18:50:27 GMT
The OffsetOutOfRangeException means that the consumer is trying to fetch
from an offset outside of the range of the log in the broker. This can
happen if the consumer has stopped consuming for a long time and part of
the log in the broker has been deleted. The other exceptions seem to be
related to certain clients getting killed.

What kind of customization did you do? Are you using the java/scala
producer/consumer provided in Kafka?

Thanks,

Jun


On Mon, Apr 23, 2012 at 11:47 PM, navneet sharma <
navneetsharma0505@gmail.com> wrote:

> Hi,
>
> I noticed few exceptions while trying my customized producer-consumer
> code:::
>
> [2012-04-16 14:26:15,385] ERROR error when processing request
> FetchRequest(topic:itemTopic, part:0 offset:460201737 maxSize:307200)
> (kafka.server.KafkaRequestHandlers)
> kafka.common.OffsetOutOfRangeException: offset 460201737 is out of range
>    at kafka.log.Log$.findRange(Log.scala:48)
>    at kafka.log.Log.read(Log.scala:224)
>    at
>
> kafka.server.KafkaRequestHandlers.kafka$server$KafkaRequestHandlers$$readMessageSet(KafkaRequestHandlers.scala:116)
>    at
>
> kafka.server.KafkaRequestHandlers$$anonfun$2.apply(KafkaRequestHandlers.scala:106)
>    at
>
> kafka.server.KafkaRequestHandlers$$anonfun$2.apply(KafkaRequestHandlers.scala:105)
>    at
>
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
>    at
>
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206)
>    at
>
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:34)
>    at scala.collection.mutable.ArrayOps.foreach(ArrayOps.scala:34)
>    at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
>    at scala.collection.mutable.ArrayOps.map(ArrayOps.scala:34)
>    at
>
> kafka.server.KafkaRequestHandlers.handleMultiFetchRequest(KafkaRequestHandlers.scala:105)
>    at
>
> kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$3.apply(KafkaRequestHandlers.scala:45)
>    at
>
> kafka.server.KafkaRequestHandlers$$anonfun$handlerFor$3.apply(KafkaRequestHandlers.scala:45)
>    at kafka.network.Processor.handle(SocketServer.scala:289)
>    at kafka.network.Processor.read(SocketServer.scala:312)
>    at kafka.network.Processor.run(SocketServer.scala:207)
>    at java.lang.Thread.run(Thread.java:662)
>
> and:::::::::::
>
> [2012-04-17 18:15:09,247] ERROR Closing socket for /127.0.0.1 because of
> error (kafka.network.Processor)
> java.io.IOException: Connection reset by peer
>    at sun.nio.ch.FileDispatcher.read0(Native Method)
>    at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
>    at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:198)
>    at sun.nio.ch.IOUtil.read(IOUtil.java:171)
>    at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:243)
>    at kafka.utils.Utils$.read(Utils.scala:485)
>    at
>
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
>    at kafka.network.Processor.read(SocketServer.scala:304)
>    at kafka.network.Processor.run(SocketServer.scala:207)
>    at java.lang.Thread.run(Thread.java:662)
>
>
> ------------------------------------------------------------------------------------
> [2012-04-23 17:25:49,325] ERROR Closing socket for /127.0.0.1 because of
> error (kafka.network.Processor)
> java.io.IOException: Broken pipe
>    at sun.nio.ch.FileDispatcher.write0(Native Method)
>    at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)
>    at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:69)
>    at sun.nio.ch.IOUtil.write(IOUtil.java:40)
>    at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:334)
>    at kafka.server.MessageSetSend.writeTo(MessageSetSend.scala:49)
>    at kafka.network.MultiSend.writeTo(Transmission.scala:95)
>    at kafka.network.Processor.write(SocketServer.scala:332)
>    at kafka.network.Processor.run(SocketServer.scala:209)
>    at java.lang.Thread.run(Thread.java:662)
>
>
> What can be the reason of these exceptions? Can they be ignored or do i
> need to change anything?
>
> Thanks,
> Navneet Sharma
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message