kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Kafka/ZK Cluster Example
Date Wed, 11 Jan 2012 21:50:04 GMT
Chrsitan,

A Kafka cluster containers a ZK cluster and a list of brokers. When a
consumer subscribes to a topic in a kafka cluster, it consumes data stored
in all brokers in that cluster.

Thanks,

Jun

On Tue, Jan 10, 2012 at 11:28 PM, Christian Carollo <ccarollo@gmail.com>wrote:

> Thank you Jun that is quite helpful.  I have a question about Kafka
> Clusters.  What are the minimum number and types of services that must be
> running to make up a Kafka Cluster?
>
> I ask this because the diagrams (in the Kafka Mirroring document) allude
> to a multiple broker environment, however, since each broker does not
> appear to provide redundancy (as of today) to any of the other brokers in a
> given zookeeper service, it seems like a Kafka Cluster is nothing more than
> a grouping of a single zookeeper instance with a single Kafka broker, is
> this the correct understanding?
>
> Thanks,
> Christian
>
> On Jan 10, 2012, at 8:47 AM, Jun Rao wrote:
>
> > With 0.7, you can set up inter-cluster replication (
> > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+mirroring).
> >
> > For the future 0.8 release, we are working on intra-cluster replication
> > support and details can be found at
> > https://issues.apache.org/jira/browse/KAFKA-50
> >
> > Thanks,
> >
> > Jun
> >
> > On Mon, Jan 9, 2012 at 9:52 PM, Christian Carollo <ccarollo@gmail.com
> >wrote:
> >
> >> I am looking to implement Kafka in a production environment, however, I
> >> haven't found in documentation or examples that
> >> discuss how to build a redundant implementation.  Is there any
> >> documentation out their (blogs, articles, etc.) that describes
> >> how we can implement such a system with Kafka 0.6 or 0.7.
> >>
> >> Also, is there a timeframe the community is shooting for, to release
> 0.8 w/
> >> replication?
> >>
> >> Thanks
> >> Christian
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message