kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guozhang Wang <wangg...@gmail.com>
Subject Re: I found kafka lsot message
Date Sun, 09 Oct 2016 17:25:30 GMT
Jerry,

Message lost scenarios usually are due to producer and consumer
mis-configured. Have you read about the client configs web docs?

http://kafka.apache.org/documentation#producerconfigs

http://kafka.apache.org/documentation#newconsumerconfigs


If not I'd suggest you reading those first and see if you can tune some of
these configs to have better delivery guarantees.

Guozhang


On Fri, Oct 7, 2016 at 9:48 PM, <yangyuqi@sina.com> wrote:

> Hello every body,I build a kafka cluster(include 5 domains) use
> kafka_2.11-0.10.0.0 and kafka-python-1.3.1.I create a topic by 100
> partitions and 2 replicate, then use 20 consumers to receive message.
> But, I found sometime the kafka lost message! I found some partition's
> offsite lost at consumer.After, I make a global index for every message
> from producer for confirm this problem, and I also found the global index
> had been break!
> Why the kafka lost message?  What can I do to fix the problem?
> Thanks!Jerry
>
> --------------------------------
>
>


-- 
-- Guozhang

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message