kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jiangjie Qin <j...@linkedin.com.INVALID>
Subject Re: Getting NotLeaderForPartitionException in kafka broker
Date Wed, 13 May 2015 22:12:47 GMT
Does this topic exist in Zookeeper?

On 5/12/15, 11:35 PM, "tao xiao" <xiaotao183@gmail.com> wrote:

>Hi,
>
>Any updates on this issue? I keep seeing this issue happening over and
>over
>again
>
>On Thu, May 7, 2015 at 7:28 PM, tao xiao <xiaotao183@gmail.com> wrote:
>
>> Hi team,
>>
>> I have a 12 nodes cluster that has 800 topics and each of which has
>>only 1
>> partition. I observed that one of the node keeps generating
>> NotLeaderForPartitionException that causes the node to be unresponsive
>>to
>> all requests. Below is the exception
>>
>> [2015-05-07 04:16:01,014] ERROR [ReplicaFetcherThread-1-12], Error for
>> partition [topic1,0] to broker 12:class
>> kafka.common.NotLeaderForPartitionException
>> (kafka.server.ReplicaFetcherThread)
>>
>> All other nodes in the cluster generate lots of replication error too as
>> shown below due to unresponsiveness of above node.
>>
>> [2015-05-07 04:17:34,917] WARN [Replica Manager on Broker 1]: Fetch
>> request with correlation id 3630911 from client
>>ReplicaFetcherThread-0-1 on
>> partition [topic1,0] failed due to Leader not local for partition
>> [cg22_user.item_attr_info.lcr,0] on broker 1
>>(kafka.server.ReplicaManager)
>>
>> Any suggestion why the node runs into the unstable stage and any
>> configuration I can set to prevent this?
>>
>> I use kafka 0.8.2.1
>>
>> And here is the server.properties
>>
>>
>> broker.id=5
>> port=9092
>> num.network.threads=3
>> num.io.threads=8
>> socket.send.buffer.bytes=1048576
>> socket.receive.buffer.bytes=1048576
>> socket.request.max.bytes=104857600
>> log.dirs=/mnt/kafka
>> num.partitions=1
>> num.recovery.threads.per.data.dir=1
>> log.retention.hours=1
>> log.segment.bytes=1073741824
>> log.retention.check.interval.ms=300000
>> log.cleaner.enable=false
>> zookeeper.connect=ip:2181
>> zookeeper.connection.timeout.ms=6000
>> unclean.leader.election.enable=false
>> delete.topic.enable=true
>> default.replication.factor=3
>> num.replica.fetchers=3
>> delete.topic.enable=true
>> kafka.metrics.reporters=report.KafkaMetricsCollector
>> straas.hubble.conf.file=/etc/kafka/report.conf
>>
>>
>>
>>
>> --
>> Regards,
>> Tao
>>
>
>
>
>-- 
>Regards,
>Tao


Mime
View raw message