kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jun Rao <jun...@gmail.com>
Subject Re: Streaming across data centers
Date Tue, 04 Jun 2013 14:48:24 GMT
You can read the following wiki on the MirrorMaker tool.

https://cwiki.apache.org/confluence/display/KAFKA/Kafka+mirroring+%28MirrorMaker%29

Thanks,

Jun


On Mon, Jun 3, 2013 at 10:58 PM, Guy Doulberg <guy.doulberg@conduit.com>wrote:

> Hi guys,
>
> I was wondering if someone here has an experience with streaming kafka
> across data-centers?
>
> How does kafka transfer the msgs? event by event or it batches some events
> in one file(how many together?) and send them to the consumer on the other
> data-center?
>
> I am asking it, because we want to have a hadoop active-active clusters
> (on two data-centers) and we might use the kafka as the sync stream from
> which both centers will consume events,
>
> Has anyone did something like that?
>
> Thanks,
> Guy Doulberg
> Data Infra team leader @ Conduit
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message