samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Davide Simoncelli <netcelli....@gmail.com>
Subject Re: Samza producer error
Date Fri, 29 May 2015 06:06:56 GMT
Thank you a lot for your help. Looking at Kafka logs the broker refused new
connection because the limit was 10.

Davide
On 29 May 2015 1:07 am, "Guozhang Wang" <wangguoz@gmail.com> wrote:

> From the logs it seems your producer (not consumer) cannot successfully
> connect to the brokers. I would suggest you trying the console-producer
> with some sample data and with the same bootstrap broker list and see if it
> works.
>
> On Wed, May 27, 2015 at 10:43 AM, Yan Fang <yanfang724@gmail.com> wrote:
>
> > Hi Davide,
> >
> > This sometimes is due to Kafka broker. Are you able to send the message
> to
> > the brokers from the command line?
> >
> > Thanks,
> >
> > Fang, Yan
> > yanfang724@gmail.com
> >
> > On Tue, May 26, 2015 at 5:49 AM, Davide Simoncelli <
> netcelli.tux@gmail.com
> > >
> > wrote:
> >
> > > Hello,
> > >
> > > I’m testing my Samza application on a 3 nodes clusters. When the kafka
> > > producer thread starts to read incoming messages, it keeps throwing the
> > > following message on most of containers:
> > >
> > > 08:19:06.451 [kafka-producer-network-thread |
> > > samza_producer-app-1-1432642687162-2] WARN
> > > o.a.kafka.common.network.Selector - Error in I/O with <host>/<ip>
> > > java.io.IOException: Connection reset by peer
> > >         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
> > > ~[na:1.8.0_45]
> > >         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> > > ~[na:1.8.0_45]
> > >         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
> > > ~[na:1.8.0_45]
> > >         at sun.nio.ch.IOUtil.read(IOUtil.java:197) ~[na:1.8.0_45]
> > >         at
> sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
> > > ~[na:1.8.0_45]
> > >         at
> > >
> >
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:60)
> > > ~[kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.common.network.Selector.poll(Selector.java:248)
> > > ~[kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> > > [kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> > > [kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> > > [kafka-clients-0.8.2.0.jar:na]
> > >         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
> > > 08:19:06.451 [kafka-producer-network-thread |
> > > samza_producer-app-1-1432642687162-2] WARN
> > > o.a.k.c.producer.internals.Sender - Got error produce response with
> > > correlation id 539 on topic-partition system-1, retrying (2147483381
> > > attempts left). Error: NETWORK_EXCEPTION
> > > 08:19:06.551 [kafka-producer-network-thread |
> > > samza_producer-app-1-1432642687162-2] WARN
> > > o.a.kafka.common.network.Selector - Error in I/O with <host>/<ip>
> > > java.io.EOFException: null
> > >         at
> > >
> >
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
> > > ~[kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.common.network.Selector.poll(Selector.java:248)
> > > ~[kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> > > [kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> > > [kafka-clients-0.8.2.0.jar:na]
> > >         at
> > > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> > > [kafka-clients-0.8.2.0.jar:na]
> > >         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
> > >
> > > It isn’t a network issue because I tried to use the
> > > kafka-console-consumer.sh script and it works just fine. Can you
> provide
> > me
> > > more details about those errors please?
> > >
> > > Thanks
> > >
> > > Davide
> >
>
>
>
> --
> -- Guozhang
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message