kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ASHOK MACHERLA <iAsh...@outlook.com>
Subject RE: Mirror Maker tool is not running
Date Mon, 06 May 2019 13:02:48 GMT
Dear Team Members



Please find these below configurations for mirror maker tool scripts



source-cluster.config



bootstrap.servers=192.168.175.128:9092,192.168.175.129:9092,192.168.175.130:9092

group.id=mirror-maker-consumer

exclude.internal.topics=true

client.id=mirror_maker_consumer

security.protocol=SSL

ssl.truststore.location=/opt/kafka/certificates/client.truststore.jks

ssl.truststore.password=Sbi#123

auto.offset.reset=earliest

max.poll.records=100





target-cluster.config



bootstrap.servers=192.128.145.253:9092,192.128.145.254:9092,192.128.145.255:9092

acks=1

client.id=mirror_maker_producer

security.protocol=SSL

ssl.truststore.location=/opt/kafka/certificates/client.truststore.jks

ssl.truststore.password=Sbi#123

shallow.iterator.enable=true



As you suggested after that i added shallow.iterator.enable=true target side configuration.

Still we are facing same issues,



********************** Mirror maker Errors*****************************



[2019-05-06 13:33:30,769] ERROR Error when sending message to topic audit-logs with key: null,
value: 1829 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)

java.lang.IllegalStateException: Producer is closed forcefully.

        at org.apache.kafka.clients.producer.internals.RecordAccumulator.abortBatches(RecordAccumulator.java:513)

        at org.apache.kafka.clients.producer.internals.RecordAccumulator.abortIncompleteBatches(RecordAccumulator.java:493)

        at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:156)

        at java.lang.Thread.run(Thread.java:748)

[2019-05-06 13:33:30,801] FATAL [mirrormaker-thread-11] Mirror maker thread exited abnormally,
stopping the whole mirror maker. (kafka.tools.MirrorMaker$MirrorMakerThread)

************************************************************************

what is type of parameters we have to use either in source side or else in producer side ???????????





Please tell me due to this we are not getting data from DC to DR cluster.

Please help to resolve this , Thanks a lot



Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10



________________________________
From: ASHOK MACHERLA <iashok7@outlook.com>
Sent: Sunday, May 5, 2019 11:19:48 PM
To: users@kafka.apache.org
Subject: Re: Mirror Maker tool is not running

Dear Ryanne

Where can I use that compression method either source side or target side???

What type of parameters can I required ??

What is the configuration ???
Can please tell Ryanne.

Thanks for your help..
Sent from Outlook

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message