kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tao xiao <xiaotao...@gmail.com>
Subject Inter Mirror maker processes offset sync
Date Wed, 21 Jan 2015 15:47:12 GMT
Hi all,

I have two mirror maker processes running on two different machines
fetching messages from same topic from one data center to another data
center. These two processes are assigned to the same consumer group. If I
want no data loss or data duplication even when one of the mirror maker
processes die I need to find a way to inform another process the offset the
last successfully sent message by the dead process but I know the offset
stored in zookeeper is the offset the last consumed message by mirror maker
not the offset last successfully sent message, is there a way to configure
mirror maker to achieve exact one message semantic?

-- 
Regards,
Tao

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message