kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benjamin Black...@b3k.us>
Subject Re: Remote Zookeeper
Date Tue, 11 Mar 2014 16:51:54 GMT
Seems you my have put your cluster in a very confused state with random
addition and removal of brokers and topics. I'd suggest deleting the
zookeeper and Kafka logs and starting over using the getting started
tutorial from the wiki.

On Tuesday, March 11, 2014, A A <andthereitgoes@hotmail.com> wrote:

> I noticed a problem with my topics. The previous two topics would only be
> present on 1 broker.  So I created a new topic
>
> $KAFKA_HOME/bin/kafka-create-topic.sh --zookeeper 192.168.1.120:2181--replica 2 --partition
1 --topic test-rep
> $KAFKA_HOME/bin/kafka-list-topic.sh --zookeeper 192.168.1.120:2181
> topic: test     partition: 0    leader: 1       replicas: 1     isr: 1
> topic: test-rep partition: 0    leader: 1       replicas: 1,2   isr: 1
> topic: test1    partition: 0    leader: 1       replicas: 1     isr: 1
>
> No there is no firewall. Even then I stopped the iptables.  And then I
> tried the following
>  $KAFKA_HOME/bin/kafka-console-producer.sh --broker-list
> 192.168.1.123:9092,192.168.1.124:9092 --topic test-rep
> replicated message
>
> [2014-03-11 10:59:25,844] WARN Error while fetching metadata
> [{TopicMetadata for topic test-rep ->
> No partition metadata for topic test-rep due to
> kafka.common.LeaderNotAvailableException}] for topic [test-rep]: class
> kafka.common.LeaderNotAvailableException
>  (kafka.producer.BrokerPartitionInfo)
> [2014-03-11 10:59:25,867] WARN Error while fetching metadata
> [{TopicMetadata for topic test-rep ->
> No partition metadata for topic test-rep due to
> kafka.common.LeaderNotAvailableException}] for topic [test-rep]: class
> kafka.common.LeaderNotAvailableException
>  (kafka.producer.BrokerPartitionInfo)
> [2014-03-11 10:59:25,868] ERROR Failed to collate messages by topic,
> partition due to: Failed to fetch topic metadata for topic: test-rep
> (kafka.producer.async.DefaultEventHandler)
> [2014-03-11 10:59:25,979] WARN Error while fetching metadata
> [{TopicMetadata for topic test-rep ->
> No partition metadata for topic test-rep due to
> kafka.common.LeaderNotAvailableException}] for topic [test-rep]: class
> kafka.common.LeaderNotAvailableException
>  (kafka.producer.BrokerPartitionInfo)
> [2014-03-11 10:59:25,986] WARN Error while fetching metadata
> [{TopicMetadata for topic test-rep ->
> No partition metadata for topic test-rep due to
> kafka.common.LeaderNotAvailableException}] for topic [test-rep]: class
> kafka.common.LeaderNotAvailableException
>  (kafka.producer.BrokerPartitionInfo)
> [2014-03-11 10:59:25,987] ERROR Failed to collate messages by topic,
> partition due to: Failed to fetch topic metadata for topic: test-rep
> (kafka.producer.async.DefaultEventHandler)
> [2014-03-11 10:59:26,098] WARN Error while fetching metadata
> [{TopicMetadata for topic test-rep ->
> No partition metadata for topic test-rep due to
> kafka.common.LeaderNotAvailableException}] for topic [test-rep]: class
> kafka.common.LeaderNotAvailableException
>  (kafka.producer.BrokerPartitionInfo)
>
>
>
>
> > Date: Tue, 11 Mar 2014 09:05:54 -0700
> > Subject: Re: Remote Zookeeper
> > From: pradeepg26@gmail.com <javascript:;>
> > To: users@kafka.apache.org <javascript:;>
> >
> > Is there a firewall thats blocking connections on port 9092? Also, the
> > broker list should be comma separated.
> >
> >
> > On Tue, Mar 11, 2014 at 9:02 AM, A A <andthereitgoes@hotmail.com> wrote:
> >
> > > Sorry one of the brokers for was down. Brought it back up. Tried the
> > > following
> > >
> > >  $KAFKA_HOME/bin/kafka-console-producer.sh --broker-list localhost:9092
> > > 192.168.1.124:9092 --topic test
> > > hello brokers
> > >
> > > [2014-03-11 10:16:55,547] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,576] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,578] ERROR Failed to collate messages by topic,
> > > partition due to: Failed to fetch topic metadata for topic: test
> > > (kafka.producer.async.DefaultEventHandler)
> > > [2014-03-11 10:16:55,693] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,706] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,706] ERROR Failed to collate messages by topic,
> > > partition due to: Failed to fetch topic metadata for topic: test
> > > (kafka.producer.async.DefaultEventHandler)
> > > [2014-03-11 10:16:55,815] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,823] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,823] ERROR Failed to collate messages by topic,
> > > partition due to: Failed to fetch topic metadata for topic: test
> > > (kafka.producer.async.DefaultEventHandler)
> > > [2014-03-11 10:16:55,934] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,949] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to
> > > kafka.common.LeaderNotAvailableException}] for topic [test]: class
> > > kafka.common.LeaderNotAvailableException
> > >  (kafka.producer.BrokerPartitionInfo)
> > > [2014-03-11 10:16:55,949] ERROR Failed to collate messages by topic,
> > > partition due to: Failed to fetch topic metadata for topic: test
> > > (kafka.producer.async.DefaultEventHandler)
> > > [2014-03-11 10:16:56,057] WARN Error while fetching metadata
> > > [{TopicMetadata for topic test ->
> > > No partition metadata for topic test due to<

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message