kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hemanth Abbina <Heman...@eiqnetworks.com>
Subject RE: Inconsistency with Zookeeper
Date Sat, 08 Aug 2015 00:59:36 GMT
Yes. I have set the unique broker ids (as 0, 1, 2) in the server.properties file

I did not get the " set broker id  in zookeeper data directory".  We don't set any broker
id in zookeeper.

We provide only "zookeeper.connect=ZK:2181,ZK2:2181,ZK3:2181" in server.properties file. Right
?

-----Original Message-----
From: Prabhjot Bharaj [mailto:prabhbharaj@gmail.com] 
Sent: Friday, August 7, 2015 8:44 PM
To: users@kafka.apache.org
Subject: Re: Inconsistency with Zookeeper

Have you set broker id  in zookeeper data directory and some unique broker Id in server.properties
?

Regards,
Prabhjot
On Aug 6, 2015 1:43 PM, "Hemanth Abbina" <HemanthA@eiqnetworks.com> wrote:

> Hi,
>
> I am running a Kafka POC with below details
>
> *         3 Node cluster (4 Core, 16 GB RAM each) running Kafka 0.8.2.1.
>
> *         Each node running Kafka & Zookeeper instances. (So total of 3
> Kafka brokers & 3 zookeepers)
>
> When I tried to create a topic using the kafka-topics.sh, observing 
> the below exceptions on the console. If I try multiple times, the 
> topic is getting created at some time. Please suggest a workaround to 
> make this work every time.
>
> Thanks in advance.
>
> [ec2-user@ip-10-20-0-196 kafka_2.10-0.8.2.1]$ ./bin/kafka-topics.sh 
> --zookeeper 10.20.0.196:2181,10.20.0.197:2181,10.20.0.198:2181 --topic
> reportspoc4 --create --partitions 1 --replication-factor 2 Error while 
> executing topic command replication factor: 2 larger than available 
> brokers: 1
> kafka.admin.AdminOperationException: replication factor: 2 larger than 
> available brokers: 1
>         at
> kafka.admin.AdminUtils$.assignReplicasToBrokers(AdminUtils.scala:70)
>         at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:171)
>         at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:93)
>         at kafka.admin.TopicCommand$.main(TopicCommand.scala:55)
>         at kafka.admin.TopicCommand.main(TopicCommand.scala)
>
>
> [ec2-user@ip-10-20-0-196 kafka_2.10-0.8.2.1]$ ./bin/kafka-topics.sh 
> --zookeeper 10.20.0.196:2181,10.20.0.197:2181,10.20.0.198:2181 --topic
> reportspoc4 --create --partitions 1 --replication-factor 2 Error while 
> executing topic command
> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode 
> = NoNode for /brokers/ids
> org.I0Itec.zkclient.exception.ZkNoNodeException:
> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode 
> = NoNode for /brokers/ids
>         at
> org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:47)
>         at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
>         at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:413)
>         at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:409)
>         at kafka.utils.ZkUtils$.getChildren(ZkUtils.scala:462)
>         at kafka.utils.ZkUtils$.getSortedBrokerList(ZkUtils.scala:78)
>         at kafka.admin.AdminUtils$.createTopic(AdminUtils.scala:170)
>         at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:93)
>         at kafka.admin.TopicCommand$.main(TopicCommand.scala:55)
>         at kafka.admin.TopicCommand.main(TopicCommand.scala)
> Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
> KeeperErrorCode = NoNode for /brokers/ids
>         at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
>         at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>         at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
>         at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1500)
>         at
> org.I0Itec.zkclient.ZkConnection.getChildren(ZkConnection.java:99)
>         at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:416)
>         at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:413)
>         at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
>         ... 8 more
>
> --regards
> Hemanth
>
Mime
View raw message