kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Roberts <wiz...@gmail.com>
Subject Re: Kafka lost data
Date Mon, 27 Oct 2014 17:31:50 GMT
I think it will depend on how your producer application logs things, but
yes I have historically seen exceptions in the producer logs when they
exceed the max message size.

-Mark

On Mon, Oct 27, 2014 at 10:19 AM, Chen Wang <chen.apache.solr@gmail.com>
wrote:

> Hello folks,
> I recently noticed our message amount in kafka seems to have dropped
> significantly. I didn't see any exception on my consumer side. Since
> producer is not within  my control, I am trying to get some guidance on how
> I could debug this issue.
>
> Our individual message size recently have increased. Will that cause
> message drop if it exceeds "message.max.bytes" on the broker side? If so, I
> should see Exceptions on the producer logs, is that right? or is there some
> kinda broker log I can check?
>
> Thanks,
> Chen
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message