incubator-s4-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Frank Zheng <bearzheng2...@gmail.com>
Subject Re: S4 Communication Layer using ZooKeeper
Date Wed, 03 Oct 2012 06:28:33 GMT
Hi Karthik,

That's very helpful.

Thanks.
Frank

On Wed, Oct 3, 2012 at 12:51 PM, Karthik Kambatla <kkambatl@cs.purdue.edu>wrote:

> Zookeeper is primarily used to keep track of the changing topology. S4 is
> aimed at running on commodity hardware - nodes might go down anytime, and
> hence the need to keep track of the topology. The topology is written to
> zookeeper, and each running node watches the zookeeper node(s) to keep
> track of any changes.
>
> Hope that helps.
>
> Thanks
> Karthik
>
>
> On Tue, Oct 2, 2012 at 9:17 PM, Frank Zheng <bearzheng2011@gmail.com>wrote:
>
>> Hi All,
>>
>> I am exploring the cluster management mechanism and fault tolerance of S4.
>> I saw that S4 used ZooKeeper in the communication layer. But it seems not
>> very clear in that pater, " S4: Distributed Stream Computing Platform".
>> I tried to search the reference "[15] Communication layer using
>> ZooKeeper, Yahoo! Inc. Tech. Rep., 2009", but it is not available.
>> Could anyone introduce me the role of ZooKeeper in S4, and the cluster
>> management mechanism in detail?
>>
>> Thanks.
>>
>> Sincerely,
>> Frank
>>
>>
>>
>>
>


-- 
Sincerely,
Zheng Yu
Mobile:  (852) 60670059
Email:    bearzheng2011@gmail.com

Mime
View raw message