kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 杰 杨 <funk...@live.com>
Subject kafka producer send failed
Date Mon, 12 Mar 2018 10:13:57 GMT
Hi:
    I used producer sending data to kafka.
due to network and other problem makes send failed .
I register callback on send data.
so I test 300W data in kafka,but only 200W data in kafka.
and 100W data in local files .

I did config retries 10 and acks is 'all' in producer.

it seems kafka didn't retry send on failure data?

this is my configuration on producer.

acks=all
retries=3
batch.size=16384
linger.ms=10
buffer.memory=67108864
max.request.size=1048576
request.timeout.ms=50000
compression.type=gzip
so anybody for help to avoid this problem ?
________________________________
funkyyj@live.com
Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message