kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeremy Hansen <jer...@skidrow.la>
Subject Re: lag for a specific partitions on newly added host
Date Sat, 10 Dec 2016 04:58:37 GMT
Here’s the topic description:

Topic:blumfrub  PartitionCount:15       ReplicationFactor:5     Configs:
        Topic: blumfrub Partition: 0    Leader: 1001    Replicas: 1001,0,1,2,3  Isr: 0,1001,1,2,3
        Topic: blumfrub Partition: 1    Leader: 0       Replicas: 0,1,2,3,4     Isr: 0,1,2,3,4
 
        Topic: blumfrub Partition: 2    Leader: 1       Replicas: 1,2,3,4,1001  Isr: 1001,1,2,3,4
        Topic: blumfrub Partition: 3    Leader: 2       Replicas: 2,3,4,1001,0  Isr: 0,1001,2,3,4
        Topic: blumfrub Partition: 4    Leader: 0       Replicas: 3,4,1001,0,1  Isr: 0,1001,1,3,4
        Topic: blumfrub Partition: 5    Leader: 4       Replicas: 4,1001,0,1,2  Isr: 0,1001,1,2,4
        Topic: blumfrub Partition: 6    Leader: 1001    Replicas: 1001,1,2,3,4  Isr: 1001,1,2,3,4
        Topic: blumfrub Partition: 7    Leader: 0       Replicas: 0,2,3,4,1001  Isr: 0,1001,2,3,4
        Topic: blumfrub Partition: 8    Leader: 1       Replicas: 1,3,4,1001,0  Isr: 0,1001,1,3,4
        Topic: blumfrub Partition: 9    Leader: 2       Replicas: 2,4,1001,0,1  Isr: 0,1001,1,2,4
        Topic: blumfrub Partition: 10   Leader: 0       Replicas: 3,1001,0,1,2  Isr: 0,1001,1,2,3
        Topic: blumfrub Partition: 11   Leader: 4       Replicas: 4,0,1,2,3     Isr: 0,1,2,3,4
 
        Topic: blumfrub Partition: 12   Leader: 1001    Replicas: 1001,2,3,4,0  Isr: 0,1001,2,3,4
        Topic: blumfrub Partition: 13   Leader: 0       Replicas: 0,3,4,1001,1  Isr: 0,1001,1,3,4
        Topic: blumfrub Partition: 14   Leader: 1       Replicas: 1,4,1001,0,2  Isr: 0,1001,1,2,4

1001 is the new broker.

-jeremy



> On Dec 9, 2016, at 8:55 PM, Jeremy Hansen <jeremy@skidrow.la> wrote:
> 
> I added a new host to kafka.  Partitions that fall on this new host have a very high
lag and I’m trying to understand why this would be and how to fix it.
> 
> iloveconsuming                      blumfrub              0          5434682        
7416933         1982251         iloveconsuming_kf0001.host.com-1481225033576-47393b55-0
> iloveconsuming                      blumfrub              1          7416828        
7416875         47              iloveconsuming_kf0001.host.com-1481225033769-17152bca-0
> iloveconsuming                      blumfrub              2          7416799        
7416848         49              iloveconsuming_kf0001.host.com-1481225033791-77a30285-0
> iloveconsuming                      blumfrub              3          7416898        
7416903         5               iloveconsuming_kf0001.host.com-1481225033822-d088f844-0
> iloveconsuming                      blumfrub              4          7416891        
7416925         34              iloveconsuming_kf0001.host.com-1481225033846-78f8e5b5-0
> iloveconsuming                      blumfrub              5          7416843        
7416883         40              iloveconsuming_kf0001.host.com-1481225033869-54027178-0
> iloveconsuming                      blumfrub              6          5434720        
7416896         1982176         iloveconsuming_kf0001.host.com-1481225033891-cc3f6bf6-0
> iloveconsuming                      blumfrub              7          7416896        
7416954         58              iloveconsuming_kf0001.host.com-1481225033915-79b49de8-0
> iloveconsuming                      blumfrub              8          7416849        
7416898         49              iloveconsuming_kf0001.host.com-1481225033939-1fe784c0-0
> iloveconsuming                      blumfrub              9          7416898        
7416917         19              iloveconsuming_kf0001.host.com-1481225033961-40cc3185-0
> iloveconsuming                      blumfrub              10         35457186       
35457221        35              iloveconsuming_kf0001.host.com-1481225033998-a817062e-0
> iloveconsuming                      blumfrub              11         7416866        
7416909         43              iloveconsuming_kf0001.host.com-1481225034020-7a15999e-0
> iloveconsuming                      blumfrub              12         5434739        
7416907         1982168         iloveconsuming_kf0001.host.com-1481225034043-badde97c-0
> iloveconsuming                      blumfrub              13         7416818        
7416865         47              iloveconsuming_kf0001.host.com-1481225034066-6e77e3dc-0
> iloveconsuming                      blumfrub              14         7416901        
7416947         46              iloveconsuming_kf0002.host.com-1481225107317-32355c51-0
> 
> Why do the partitions that fall on the newly added host so lagged?
> 
> Thanks
> -jeremy


Mime
View raw message