samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: Samza producer error
Date Fri, 29 May 2015 00:06:29 GMT
>From the logs it seems your producer (not consumer) cannot successfully
connect to the brokers. I would suggest you trying the console-producer
with some sample data and with the same bootstrap broker list and see if it
works.

On Wed, May 27, 2015 at 10:43 AM, Yan Fang <yanfang724@gmail.com> wrote:

> Hi Davide,
>
> This sometimes is due to Kafka broker. Are you able to send the message to
> the brokers from the command line?
>
> Thanks,
>
> Fang, Yan
> yanfang724@gmail.com
>
> On Tue, May 26, 2015 at 5:49 AM, Davide Simoncelli <netcelli.tux@gmail.com
> >
> wrote:
>
> > Hello,
> >
> > I’m testing my Samza application on a 3 nodes clusters. When the kafka
> > producer thread starts to read incoming messages, it keeps throwing the
> > following message on most of containers:
> >
> > 08:19:06.451 [kafka-producer-network-thread |
> > samza_producer-app-1-1432642687162-2] WARN
> > o.a.kafka.common.network.Selector - Error in I/O with <host>/<ip>
> > java.io.IOException: Connection reset by peer
> >         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
> > ~[na:1.8.0_45]
> >         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> > ~[na:1.8.0_45]
> >         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
> > ~[na:1.8.0_45]
> >         at sun.nio.ch.IOUtil.read(IOUtil.java:197) ~[na:1.8.0_45]
> >         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
> > ~[na:1.8.0_45]
> >         at
> >
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:60)
> > ~[kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.common.network.Selector.poll(Selector.java:248)
> > ~[kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> > [kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> > [kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> > [kafka-clients-0.8.2.0.jar:na]
> >         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
> > 08:19:06.451 [kafka-producer-network-thread |
> > samza_producer-app-1-1432642687162-2] WARN
> > o.a.k.c.producer.internals.Sender - Got error produce response with
> > correlation id 539 on topic-partition system-1, retrying (2147483381
> > attempts left). Error: NETWORK_EXCEPTION
> > 08:19:06.551 [kafka-producer-network-thread |
> > samza_producer-app-1-1432642687162-2] WARN
> > o.a.kafka.common.network.Selector - Error in I/O with <host>/<ip>
> > java.io.EOFException: null
> >         at
> >
> org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:62)
> > ~[kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.common.network.Selector.poll(Selector.java:248)
> > ~[kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
> > [kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
> > [kafka-clients-0.8.2.0.jar:na]
> >         at
> > org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
> > [kafka-clients-0.8.2.0.jar:na]
> >         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
> >
> > It isn’t a network issue because I tried to use the
> > kafka-console-consumer.sh script and it works just fine. Can you provide
> me
> > more details about those errors please?
> >
> > Thanks
> >
> > Davide
>



-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message