kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steven Wu <stevenz...@gmail.com>
Subject Re: could new java producer miss callbacks after successful send?
Date Tue, 10 Feb 2015 04:23:03 GMT
I don't have strong evidence that this is a bug yet. let me write some test
program and see if I can confirm/reproduce the issue.

On Mon, Feb 9, 2015 at 7:59 PM, Jay Kreps <jay.kreps@gmail.com> wrote:

> Hmm, that does sound like a bug, we haven't seen that. How easy is it to
> reproduce this?
>
> -Jay
>
> On Mon, Feb 9, 2015 at 5:19 PM, Steven Wu <stevenz3wu@gmail.com> wrote:
>
> > We observed some small discrepancy in messages sent per second reported
> at
> > different points. 1) and 4) matches very close. 2) and 3) matches very
> > close but are about *5-6% lower* compared to 1) and 4).
> > 1) send attempt from producer
> > 2) send success from producer
> > 3) record-send-rate reported by kafka producer
> > 4) MessagesInPerSecond reported by kafka broker
> >
> > note that send success for 2) is incremented when onCompletion is called
> > without error/exception). there is also a send error count when
> > onCompletion is called with error. it is always zero.
> >
> > that's why I am wondering whether there are some callback misses?
> >
> > some info about the setup
> > * producer: 0.8.2-beta
> > * broker: 0.8.1.1
> > * acks=1
> >
> > Thanks,
> > Steven
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message