kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ewen Cheslack-Postava <e...@confluent.io>
Subject Re: Running mirror maker between two different version of kafka
Date Sun, 11 Dec 2016 02:45:31 GMT
It's tough to read that stacktrace, but if I understand what you mean by
"running the kafka mirroring in destination cluster which is 0.10.1.0
version of kafka", then the problem is that you cannot use 0.10.1.0 mirror
maker with an 0.8.1. cluster. MirrorMaker is both a producer and consumer,
so the version used has to be client-compatible with both source and
destination clusters. For Kafka that means the client (MM) can use at most
version min(src cluster version, dest cluster version).

-Ewen

On Thu, Dec 8, 2016 at 6:24 PM, Vijayanand Rengarajan <
vijayanand.rengarajan@yahoo.com.invalid> wrote:

> Team,
> I am trying to mirror few topics from cluster A( version 0.8.1) to Cluster
> B (version 0.10.1.0), but due to version incompatibility I am getting below
> error.if any one of you had similar issues, please share the work
> around/solution to this issue.
> I am running the kafka mirroring in destination cluster which is 0.10.1.0
> version of kafka  installed.
> There is no firewall and iptables between these two clusters.
>  WARN [ConsumerFetcherThread-console-consumer-27615_
> kafkanode01-1481247967907-68767097-0-30], Error in fetch kafka.consumer.
> ConsumerFetcherThread$FetchRequest@26902baa (kafka.consumer.
> ConsumerFetcherThread)java.io.EOFException at org.apache.kafka.common.
> network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at
> kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:129)
> at kafka.network.BlockingChannel.receive(BlockingChannel.scala:120) at
> kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:99) at
> kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$
> $sendRequest(SimpleConsumer.scala:83) at kafka.consumer.SimpleConsumer$
> $anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:132)
> at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$
> apply$mcV$sp$1.apply(SimpleConsumer.scala:132) at
> kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$
> apply$mcV$sp$1.apply(SimpleConsumer.scala:132) at
> kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at
> kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:131)
> at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:131)
> at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:131)
> at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at
> kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:130) at
> kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:109)
> at kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:29)
> at kafka.server.AbstractFetcherThread.processFetchRequest(
> AbstractFetcherThread.scala:118) at kafka.server.
> AbstractFetcherThread.doWork(AbstractFetcherThread.scala:103) at
> kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
>
> Thanks, vijayanand.




-- 
Thanks,
Ewen

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message