chukwa-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eric Fiala <>
Subject Re: Using Chukwa as monitoring tool.
Date Thu, 16 Dec 2010 14:54:32 GMT
It is possible to integrate data collected from chukwa collectors and
convert it to any format (dunno if code for RRD exists but writing the
conversion would be fairly trivial), however your requirement for an
agent-less setup cannot be filled by chukwa.

My understanding is that honu provides similar log harvesting functionality,
without the requirement for agents.

That said, ganglia is a fairly proven workhorse, out-of-box I have yet to
encounter a simpler technology that provides as much cluster-centric metrics
- unfortunately the agent is required.


On 16 December 2010 05:34, Akshay Kumar <> wrote:

> Hi,
> I have a Hadoop installation, and I want to collect some basic OS level
> metrics like  - cpu, memory, disk usage, and Hadoop metrics.
> I have looked into Ganglia, but it requires installing agents on client
> machines, which is what I want to avoid.
> My queries:
> a) Is this a fair use case for using chukwa? e.g. polling client machines
> for CPU stats few times per minute?
> b) Is it possible to integrate data collected from chukwa collectors in a
> form readable by rrdtool kind of graphing tools on the server side?
> Thanks,
> Akshay

View raw message