kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benjamin Black...@b3k.us>
Subject Re: redis versus zookeeper to track consumer offsets
Date Tue, 17 Dec 2013 19:01:56 GMT
ZK was designed from the start as a clustered, consistent, highly available
store for this sort of data and it works extremely well. Redis wasn't and I
don't know anyone using Redis in production, including me, who doesn't have
stories of Redis losing data. I'm sticking with ZK.


On Tue, Dec 17, 2013 at 10:57 AM, S Ahmed <sahmed1020@gmail.com> wrote:

> I am leaning towards using redis to track consumer offsets etc., but I see
> how using zookeeper makes sense since it already part of the kafka infra.
>
> One thing which bothers me is, how are you guys keeping track of the load
> on zookeeper?  How do you get an idea when your zookeeper cluster is
> underprovisioned?
>
> Redis is a richer store and could help in other areas where you want to
> store more than just status information or offsets, and setup and
> administration wise it seems a bit easier to manage.
>
> Thoughts?
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message