kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Binita Bharati <binita.bhar...@gmail.com>
Subject Re: Consumer group ID for high level consumer
Date Wed, 26 Feb 2014 06:53:30 GMT
Hi Jun,

I am able to get the data at times on changing the consumer threads count.
My topic (test5) has 6 partitions spread across 3 Kafka servers in a
cluster.
Here is what it looks like :
topic: test5    partition: 0    leader: 2       replicas: 2,0,1 isr: 2,0,1
topic: test5    partition: 1    leader: 0       replicas: 0,1,2 isr: 0,1,2
topic: test5    partition: 2    leader: 1       replicas: 1,2,0 isr: 1,2,0
topic: test5    partition: 3    leader: 2       replicas: 2,1,0 isr: 2,1,0
topic: test5    partition: 4    leader: 0       replicas: 0,2,1 isr: 0,2,1
topic: test5    partition: 5    leader: 1       replicas: 1,0,2 isr: 1,0,2

When I tried invoking the eg with exactly 6 threads, the it.hasNext returns
false, and the program exists.
When I increased the thread count to 100, it worked once.. But, increasing
thread count to more than no of partitions doesn't work always.

Thanks



On Wed, Feb 26, 2014 at 10:39 AM, Jun Rao <junrao@gmail.com> wrote:

> Yes, consumer group ID can be any value. In your example, does hasNext()
> return false or hit an exception?
>
> Thanks,
>
> Jun
>
>
> On Tue, Feb 25, 2014 at 8:31 PM, Binita Bharati <binita.bharati@gmail.com
> >wrote:
>
> > Hi Steve,
> >
> > So, I assume that consumer group ID is just a logical grouping ? i.e. it
> > can be any random  value ?
> > Actually, I am unable to get any data when I am running this eg :
> > https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example
> .
> > The "ConsumerTest" class's , while(it.hasNext()) check isn't successful.
> (
> > Data is present on the concerned topic)
> >
> > Any idea why ? I am using kafka-0.8.0.
> >
> > Thanks
> > Binita
> >
> >
> > On Tue, Feb 25, 2014 at 12:08 PM, Binita Bharati
> > <binita.bharati@gmail.com>wrote:
> >
> > > Hi all,
> > >
> > > I am referring to this e.g:
> > >
> https://cwiki.apache.org/confluence/display/KAFKA/Consumer+Group+Example
> > .
> > >
> > > What is the consumer group ID being referred here ?
> > >
> > > Thanks
> > > Binita
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message