kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vijayanand.rengarajan" <vijayanand.rengara...@yahoo.com.INVALID>
Subject Re: Running mirror maker between two different version of kafka
Date Fri, 16 Dec 2016 17:05:35 GMT
Hi Ewen,

Thanks for the support. I ran mirror maker on source cluster (0.8.1.0) and that was successful.

Thanks, Vijayanand.



Sent from my iPhone

> On Dec 10, 2016, at 6:45 PM, Ewen Cheslack-Postava <ewen@confluent.io> wrote:
> 
> It's tough to read that stacktrace, but if I understand what you mean by "running the
kafka mirroring in destination cluster which is 0.10.1.0 version of kafka", then the problem
is that you cannot use 0.10.1.0 mirror maker with an 0.8.1. cluster. MirrorMaker is both a
producer and consumer, so the version used has to be client-compatible with both source and
destination clusters. For Kafka that means the client (MM) can use at most version min(src
cluster version, dest cluster version).
> 
> -Ewen
> 
>> On Thu, Dec 8, 2016 at 6:24 PM, Vijayanand Rengarajan <vijayanand.rengarajan@yahoo.com.invalid>
wrote:
>> Team,
>> I am trying to mirror few topics from cluster A( version 0.8.1) to Cluster B (version
0.10.1.0), but due to version incompatibility I am getting below error.if any one of you had
similar issues, please share the work around/solution to this issue.
>> I am running the kafka mirroring in destination cluster which is 0.10.1.0 version
of kafka  installed.
>> There is no firewall and iptables between these two clusters.
>>  WARN [ConsumerFetcherThread-console-consumer-27615_kafkanode01-1481247967907-68767097-0-30],
Error in fetch kafka.consumer.ConsumerFetcherThread$FetchRequest@26902baa (kafka.consumer.ConsumerFetcherThread)java.io.EOFException
at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83)
at kafka.network.BlockingChannel.readCompletely(BlockingChannel.scala:129) at kafka.network.BlockingChannel.receive(BlockingChannel.scala:120)
at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:99) at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(SimpleConsumer.scala:132)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:132)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1$$anonfun$apply$mcV$sp$1.apply(SimpleConsumer.scala:132)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply$mcV$sp(SimpleConsumer.scala:131)
at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:131) at kafka.consumer.SimpleConsumer$$anonfun$fetch$1.apply(SimpleConsumer.scala:131)
at kafka.metrics.KafkaTimer.time(KafkaTimer.scala:33) at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:130)
at kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:109) at kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:29)
at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:118)
at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:103) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
>> 
>> Thanks, vijayanand.
> 
> 
> 
> -- 
> Thanks,
> Ewen

Mime
  • Unnamed multipart/alternative (inline, 7-Bit, 0 bytes)
View raw message