kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Peter Bukowinski <pmb...@gmail.com>
Subject Re: Kafka Topic Partition Consumer Lags
Date Thu, 27 Jun 2019 00:12:54 GMT
Is there a correlation between the lagging partitions and the consumer assigned to them?

> On Jun 26, 2019, at 4:25 PM, Garvit Sharma <eng.garvit@gmail.com> wrote:
> 
> Can anyone please help me with this.
> 
> On Wed, Jun 26, 2019 at 8:56 PM Garvit Sharma <eng.garvit@gmail.com> wrote:
> 
>> Hey Steve,
>> 
>> I have checked, count of messages on all the partitions are same.
>> 
>> I am still exploring an approach using which the root cause could be
>> determined.
>> 
>> Thanks,
>> 
>> On Wed, Jun 26, 2019 at 8:07 PM Garvit Sharma <eng.garvit@gmail.com>
>> wrote:
>> 
>>> I am not sure about that. Is there a way to analyse that ?
>>> 
>>> On Wed, Jun 26, 2019 at 7:35 PM Steve Howard <steve.howard@confluent.io>
>>> wrote:
>>> 
>>>> Hi Garvit,
>>>> 
>>>> Are the slow partitions "hot", i.e., receiving a lot more messages than
>>>> others?
>>>> 
>>>> Thanks,
>>>> 
>>>> Steve
>>>> 
>>>> On Wed, Jun 26, 2019, 9:56 AM Garvit Sharma <eng.garvit@gmail.com wrote:
>>>> 
>>>>> Just to add more details, these consumers are processing the Kafka
>>>> events
>>>>> and writing to DB(fast write guaranteed).
>>>>> 
>>>>> On Wed, Jun 26, 2019 at 7:23 PM Garvit Sharma <eng.garvit@gmail.com>
>>>>> wrote:
>>>>> 
>>>>>> Hi All,
>>>>>> 
>>>>>> I can see huge consumer lag in a few partitions of Kafka topic. I
>>>> need to
>>>>>> know the root cause of this issue.
>>>>>> 
>>>>>> Please let me know, how to proceed.
>>>>>> 
>>>>>> Below is sample consumer lag data :
>>>>>> 
>>>>>> [image: image.png]
>>>>>> 
>>>>>> Thanks,
>>>>>> 
>>>>>> 
>>>>> 
>>>> 
>>> 


Mime
View raw message