kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tousif <tousif.pa...@gmail.com>
Subject Re: kafka brokers going down within 24 hrs
Date Wed, 14 Jan 2015 16:42:07 GMT
Thanks harsha for quick response.
I don't see any other error. I used to see replica fetcher error but seems
to be disappeared after setting replica fetcher threads to 2 as I have 2
partitions. Some times I see zookeeper session expiration.
On Jan 14, 2015 8:02 PM, "Harsha" <kafka@harsha.io> wrote:

> Tousif,
>        Do you see any other errors in server.log
> -Harsha
>
> On Wed, Jan 14, 2015, at 01:51 AM, Tousif wrote:
> > Hello,
> >
> > I have configured kafka nodes to run via supervisord  and see following
> > exceptions
> > and eventually brokers going out of memory. i have given enough memory
> > and
> > process 1 event/second. kafka goes down every day
> >
> > i'm wondering what configurastion is missing or need to be added
> >
> > Here are my cluster details:
> >  2 brokers
> >  1 zookeeper
> > and 2 node apache storm
> >
> >
> > INFO zookeeper state changed (SyncConnected)
> > (org.I0Itec.zkclient.ZkClient)
> > ERROR Closing socket for /10.0.0.11 because of error
> > (kafka.network.Processor)
> > java.io.IOException: Connection reset by peer
> > at sun.nio.ch.FileDispatcher.read0(Native Method)
> > at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
> > at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:198)
> > at sun.nio.ch.IOUtil.read(IOUtil.java:171)
> > at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:245)
> > at kafka.utils.Utils$.read(Utils.scala:375)
> > at
> >
> kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
> > at kafka.network.Processor.read(SocketServer.scala:347)
> > at kafka.network.Processor.run(SocketServer.scala:245)
> > at java.lang.Thread.run(Thread.java:662)
> > [2015-01-13 23:43:37,962] INFO Closing socket connection to /10.0.0.11.
> > (kafka.network.Processor)
> > Error occurred during initialization of VM
> > Could not reserve enough space for object heap
> > Error occurred during initialization of VM
> > Could not reserve enough space for object heap
> >
> >
> >
> >
> > --
> > Regards,
> > Tousif
> > +918050227279
> >
> >
> > --
> >
> >
> > Regards
> > Tousif Khazi
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message