kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Su She <suhsheka...@gmail.com>
Subject java.nio.channels.ClosedChannelException...Firewall Issue?
Date Tue, 20 Jan 2015 01:46:42 GMT
Hello Everyone,

Thank you for the help!

Preface: I've created producers/consumers before and they have worked. I
have also made consumers/producers using java programs, but they have all
been locally.

1) I have a Zookeeper/Kafka Server running on an EC2 instance called "A"

2) I started the Zookeeper/Kafka Server on A and created a topic "test"
like it says on the kafka documentation

3) I then started a console consumer on A like the documentation states for
test.

4) I then downloaded Kafka on EC2 instance called "B" and created a console
producer with broker with broker-list public.ip.of.A:9092 and topic test.

5) Once I start publishing messages this is the message I get (what's worse
is that I can't cntrl C to stop and have to exit putty):

WARN Fetching topic metadata with correlation id 16 for topics [Set(test)]
from broker [id:0,host:54.183.40.224,port:9092] failed
(kafka.client.ClientUtils$)

java.nio.channels.ClosedChannelException

        at kafka.network.BlockingChannel.send(BlockingChannel.scala:97)

        at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:74)

        at
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:73)

        at kafka.producer.SyncProducer.send(SyncProducer.scala:114)

        at
kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:58)

        at
kafka.producer.BrokerPartitionInfo.updateInfo(BrokerPartitionInfo.scala:82)

        at
kafka.producer.async.DefaultEventHandler$$anonfun$handle$2.apply$mcV$sp(DefaultEventHandler.scala:78)

        at kafka.utils.Utils$.swallow(Utils.scala:172)

        at kafka.utils.Logging$class.swallowError(Logging.scala:106)

        at kafka.utils.Utils$.swallowError(Utils.scala:45)

        at
kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:78)

        at
kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThread.scala:104)

        at
kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThread.scala:93)

        at
kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:44)

[2015-01-20 01:29:28,289] ERROR fetching topic metadata for topics
[Set(test)] from broker [ArrayBuffer(id:0,host:

Meanwhile in ZK...not sure if this happened as soon as I started publishing
messages:

Error:KeeperErrorCode = NoNode for /consumers/console-consumer-2615/offsets
(org.apache.zookeeper.server.PrepRequestProcessor)

Any tips/suggestions are greatly appreciated!

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message