kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arnaud Lawson <arnaud.law...@velos.io>
Subject Re: Kafka metrics: Bytesout greater than Bytesin??
Date Tue, 29 Apr 2014 21:13:23 GMT
We are using Kafka 0.7.1 and i believe replication isn't available for this
version (correct me if i am wrong)...

Basically we want to be able to measure the rate of consumption for some
particular topic and make sure that this rate is about the same as the rate
of production for that topic. Which JMX metrics could be appropriate for
this - for Kafka 0.7? Thanks.


On Tue, Apr 29, 2014 at 4:28 PM, Bae, Jae Hyeon <metacret@gmail.com> wrote:

> Are you using 0.8? BytesOut will include the traffic for replication. If
> you have no consumer and replication factor is 2, BytesOut should be
> exactly double of BytesIn.
>
>
> On Tue, Apr 29, 2014 at 1:26 PM, Arnaud Lawson <arnaud.lawson@velos.io
> >wrote:
>
> > Hello,
> >
> > After graphing the cumulative values of Bytesin and Bytesout for one of
> our
> > Kafka topics, we've noticed that the Bytesout values are sometimes
> greater
> > than the Bytesin values. We are not really sure how this would be
> possible
> > if the max that a consumer can consume would be what has been put on the
> > queue for that topic. Any explanations? Thanks.
> >
> > --
> >
> > ​Arnaud Lawson​
> > ,
> > ​
> > Systems Operations Engineer
> > *VELOS*
> > Accelerating Machine Learning.
> >
> > 440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001
> > C: (240) 393 - 6703
> > F: 646.349.4063
> > E: arnaud.lawson@velos.io
> > W: www.velos.io
> >
>



-- 

​Arnaud Lawson​
,
​
Systems Operations Engineer
*VELOS*
Accelerating Machine Learning.

440 9th AVE, 11TH FLOOR, NEW YORK, NY 10001
C: (240) 393 - 6703
F: 646.349.4063
E: arnaud.lawson@velos.io
W: www.velos.io

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message