kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yifan Ying <nafan...@gmail.com>
Subject Mirrormaker between 0.8.2.1 cluster and 0.10 cluster
Date Fri, 29 Jul 2016 07:04:44 GMT
Hi all,

I am trying to use the mirrormaker on the 0.10 cluster to mirror the
0.8.2.1 cluster into 0.10 cluster. Then I got a bunch of consumer errors as
follows:

 Error in fetch kafka.consumer.ConsumerFetcherThread$FetchRequest@f9533ee
(kafka.consumer.ConsumerFetcherThread)

java.nio.BufferUnderflowException

at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:145)

at java.nio.ByteBuffer.get(ByteBuffer.java:694)

at kafka.api.ApiUtils$.readShortString(ApiUtils.scala:40)

at kafka.api.TopicData$.readFrom(FetchResponse.scala:96)

at kafka.api.FetchResponse$$anonfun$4.apply(FetchResponse.scala:170)

at kafka.api.FetchResponse$$anonfun$4.apply(FetchResponse.scala:169)

at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)

at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)

at scala.collection.immutable.Range.foreach(Range.scala:160)

at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241)

at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104)

at kafka.api.FetchResponse$.readFrom(FetchResponse.scala:169)

at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:135)

at
kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:108)

at
kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:29)

at
kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:107)

at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:98)

at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)


Error in fetch kafka.consumer.ConsumerFetcherThread$FetchRequest@5d1339d8

java.lang.IllegalArgumentException

at java.nio.Buffer.limit(Buffer.java:267)

at kafka.api.FetchResponsePartitionData$.readFrom(FetchResponse.scala:38)

at kafka.api.TopicData$$anonfun$1.apply(FetchResponse.scala:100)

at kafka.api.TopicData$$anonfun$1.apply(FetchResponse.scala:98)

at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)

at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)

at scala.collection.immutable.Range.foreach(Range.scala:141)

at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)

at scala.collection.AbstractTraversable.map(Traversable.scala:105)

at kafka.api.TopicData$.readFrom(FetchResponse.scala:98)

at kafka.api.FetchResponse$$anonfun$4.apply(FetchResponse.scala:170)

at kafka.api.FetchResponse$$anonfun$4.apply(FetchResponse.scala:169)

at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)

at
scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:251)

at scala.collection.immutable.Range.foreach(Range.scala:141)

at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:251)

at scala.collection.AbstractTraversable.flatMap(Traversable.scala:105)

at kafka.api.FetchResponse$.readFrom(FetchResponse.scala:169)

at kafka.consumer.SimpleConsumer.fetch(SimpleConsumer.scala:135)

at
kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:108)

at
kafka.consumer.ConsumerFetcherThread.fetch(ConsumerFetcherThread.scala:29)

at
kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:107)

at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:98)

Is there any compatibility issue when using the new mirrormaker to mirror a
0.8.2.1 cluster into a 0.10 cluster?

Thanks.


-- 
Yifan

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message