kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Bedford <ch...@buildlackey.com>
Subject Produce/Consumer Example With In-Memory Kafka and Zookeeper Test Fixture Servers - i would welcome help with the Maven dependencies.
Date Tue, 22 Oct 2013 23:02:53 GMT
Hi, Kafka users -

I'm just starting out with the framework and I've created a Maven-buildable
example that
should work out of the box.

The example is available here > https://github.com/buildlackey/cep
and it illustrates how to:

* unit test message passing between Kafka producers and consumers
  using basic String serialization.

* use of Netflix's curator API to instantiate an in-process zookeeper
  server, together with an in-memory instance of the
  kafka.server.KafkaServer class

* ensure that all threads launched by Kafka and zookeeper are cleanly

There is one thing that I would welcome some help with, and that is the
Maven dependencies.

 I have been fighting to find a Maven pom.xml recipe that will allow me to
pull in an official version of Kafka from a public Maven repository. I did
manage to get my example working, but for now I have had to hack my
dependencies so that the version of Kafka I use is pulled from a
work-in-progress version of a storm-kafka integration project. I'm
concerned the 'wip' versions below will be deprecated. Then this project
will lose its dependencies and fail to build properly. Also, I really
shouldn't be introducing storm for this simple Kafka example at this point
in any case.




Chris Bedford

Founder & Lead Lackey
Build Lackey Labs:  http://buildlackey.com
Go Grails!: http://blog.buildlackey.com

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message