kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From François Langelier <f.langel...@gmail.com>
Subject Re: Data is been written in only 1 partition
Date Fri, 01 Aug 2014 17:59:34 GMT
Thanks guys! I found my problem :)

I'm using the DefaultPartitioner and I was using the topic name as key...
I though it was doing a round-robin like in kafka 0.7 and not a hash of the
key...

Thank you for your help, it's really appreciate!:)




François Langelier
Étudiant en génie Logiciel - École de Technologie Supérieure
<http://www.etsmtl.ca/>
Capitaine Club Capra <http://capra.etsmtl.ca/>
VP-Communication - CS Games <http://csgames.org> 2014
Jeux de Génie <http://www.jdgets.com/> 2011 à 2014
Argentier Fraternité du Piranha <http://fraternitedupiranha.com/> 2012-2014
Comité Organisateur Olympiades ÉTS 2012
Compétition Québécoise d'Ingénierie 2012 - Compétition Senior


On Fri, Aug 1, 2014 at 1:18 PM, Jun Rao <junrao@gmail.com> wrote:

> Have you looked at
>
> https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whyisdatanotevenlydistributedamongpartitionswhenapartitioningkeyisnotspecified
> ?
>
> Thanks,
>
> Jun
>
>
> On Fri, Aug 1, 2014 at 7:33 AM, François Langelier <f.langelier@gmail.com>
> wrote:
>
> > HI all!
> >
> > I think I already saw this question on the mailing list, but I'm not able
> > to find it back...
> >
> > I'm using kafka 0.8.1.1, i have 3 brokers and I have a default
> replication
> > factor of 2 and a default partitioning factor of 2.
> >
> > My partition are distributed fairly on every brokers.
> >
> > My problem is that for all the topics I have, my data is only send to
> > either the partition 0 or the partition 1 (and correctly replicated). All
> > my brokers are in sync and the data is on every brokers (depending on
> where
> > the partitions are).
> >
> > How can I made my producer / brokers write to the other partition??
> >
> > Thanks!
> >
> > François Langelier
> > Étudiant en génie Logiciel - École de Technologie Supérieure
> > <http://www.etsmtl.ca/>
> > Capitaine Club Capra <http://capra.etsmtl.ca/>
> > VP-Communication - CS Games <http://csgames.org> 2014
> > Jeux de Génie <http://www.jdgets.com/> 2011 à 2014
> > Argentier Fraternité du Piranha <http://fraternitedupiranha.com/>
> > 2012-2014
> > Comité Organisateur Olympiades ÉTS 2012
> > Compétition Québécoise d'Ingénierie 2012 - Compétition Senior
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message