samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ash W Matheson <>
Subject New to Samza/Yarn and having Kafka issues
Date Sun, 22 Mar 2015 17:35:22 GMT
Hey all,

Evaluating Samza currently and am running into some odd issues.

I'm currently working off the 'hello-samza' repo and trying to parse a
simple kafka topic that I've produced through an extenal java app (nothing
other than a series of sentences) and it's failing pretty hard for me. The
base 'hello-samza' set of apps works fine, but as soon as I change the
configuration to look at a different Kafka/zookeeper I get the following in
the userlogs:

2015-03-22 17:07:09 KafkaSystemAdmin [WARN] Unable to fetch last offsets
for streams [myTopic] due to kafka.common.KafkaException: fetching topic
metadata for topics [Set(myTopic)] from broker
[ArrayBuffer(id:0,host:redacted,port:9092)] failed. Retrying.

The modifications are pretty straightforward.  In the, I've changed the following:

and in the actual java file
  public void process(IncomingMessageEnvelope envelope, MessageCollector
collector, TaskCoordinator coordinator) {
    Map<String, Object> jsonObject = (Map<String, Object>)
    WikipediaFeedEvent event = new WikipediaFeedEvent(jsonObject);

    try {

And then following the compile/extract/run process outlined in the
hello-samza website.

Any thoughts?  I've looked online for any 'super simple' examples of
ingesting kafka in samza with very little success.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message