kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: CreateMessageStream API
Date Mon, 02 Jun 2014 16:49:46 GMT
Currently, that's probably what you have to do. We are designing a consumer
with better apis (
https://cwiki.apache.org/confluence/display/KAFKA/Kafka+0.9+Consumer+Rewrite+Design
).

Thanks,

Jun


On Mon, Jun 2, 2014 at 1:14 AM, Kumar Pradeep <KPradeep@novell.com> wrote:

> Hi,
> I need to create a single partition from a single topic in Kafka. I am
> doing this because the order of messages coming from my Kafka producer is
> very important to me (if I tried to have multiple partition with multiple
> threads doing I/O, my ordering of messages is not guaranteed; at least this
> is what i have read). But I do have multiple consumers consuming the same
> message streams (strictly in the order that the producer produced them).
> Now, since, I am going to have only one thread per consumer in Kafka, I
> would like to think that I don't have to write the following code:
>
> Map<String, Integer> topicCountMap = new HashMap<String, Integer>();
> topicCountMap.put(topic, new Integer(a_numThreads));
> Map<String, List<KafkaStream<byte[], byte[]>>> consumerMap =
> consumer.createMessageStreams(topicCountMap);
>
> I need to create message streams without passing topic count map. I just
> know that I got a solitary topic and a single thread. I dont want to create
> a hashmap of topics and threads.
> If you can suggest me the best way to deal with this, would appreciate a
> lot.
> Thanks, Pradeep.
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message