kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From SenthilKumar K <senthilec...@gmail.com>
Subject Re: Mirror Maker tool is not running
Date Tue, 07 May 2019 07:43:53 GMT
Looks like you are hitting :
https://issues.apache.org/jira/browse/KAFKA-6947  or
https://jira.apache.org/jira/browse/KAFKA-6177

--Senthil

On Mon, May 6, 2019 at 6:32 PM ASHOK MACHERLA <iAshok7@outlook.com> wrote:

> Dear Team Members
>
>
>
> Please find these below configurations for mirror maker tool scripts
>
>
>
> *source-cluster.config*
>
>
>
> bootstrap.servers=192.168.175.128:9092,192.168.175.129:9092,
> 192.168.175.130:9092
>
> group.id=mirror-maker-consumer
>
> exclude.internal.topics=true
>
> client.id=mirror_maker_consumer
>
> security.protocol=SSL
>
> ssl.truststore.location=/opt/kafka/certificates/client.truststore.jks
>
> ssl.truststore.password=Sbi#123
>
> auto.offset.reset=earliest
>
> max.poll.records=100
>
>
>
>
>
> *target-cluster.config*
>
>
>
> bootstrap.servers=192.128.145.253:9092,192.128.145.254:9092,
> 192.128.145.255:9092
>
> acks=1
>
> client.id=mirror_maker_producer
>
> security.protocol=SSL
>
> ssl.truststore.location=/opt/kafka/certificates/client.truststore.jks
>
> ssl.truststore.password=Sbi#123
>
> *shallow.iterator.enable=true*
>
>
>
> As you suggested after that i added * shallow.iterator.enable=true*
> target side configuration.
>
> Still we are facing same issues,
>
>
>
> *********************** Mirror maker Errors******************************
>
>
>
> [2019-05-06 13:33:30,769] ERROR Error when sending message to topic
> audit-logs with key: null, value: 1829 bytes with error:
> (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
>
> java.lang.IllegalStateException: Producer is closed forcefully.
>
>         at
> org.apache.kafka.clients.producer.internals.RecordAccumulator.abortBatches(RecordAccumulator.java:513)
>
>         at
> org.apache.kafka.clients.producer.internals.RecordAccumulator.abortIncompleteBatches(RecordAccumulator.java:493)
>
>         at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:156)
>
>         at java.lang.Thread.run(Thread.java:748)
>
> [2019-05-06 13:33:30,801] FATAL [mirrormaker-thread-11] Mirror maker
> thread exited abnormally, stopping the whole mirror maker.
> (kafka.tools.MirrorMaker$MirrorMakerThread)
>
> **************************************************************************
>
> what is type of parameters we have to use either in source side or else in
> producer side ???????????
>
>
>
>
>
> Please tell me due to this we are not getting data from DC to DR cluster.
>
> Please help to resolve this , Thanks a lot
>
>
>
> Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for
> Windows 10
>
>
> ------------------------------
> *From:* ASHOK MACHERLA <iashok7@outlook.com>
> *Sent:* Sunday, May 5, 2019 11:19:48 PM
> *To:* users@kafka.apache.org
> *Subject:* Re: Mirror Maker tool is not running
>
> Dear Ryanne
>
> Where can I use that compression method either source side or target
> side???
>
> What type of parameters can I required ??
>
> What is the configuration ???
> Can please tell Ryanne.
>
> Thanks for your help..
> Sent from Outlook
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message