chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Yang (JIRA)" <>
Subject [jira] Updated: (CHUKWA-545) Add ability to stream Hadoop metrics through syslog appender
Date Mon, 08 Nov 2010 01:57:07 GMT


Eric Yang updated CHUKWA-545:

    Resolution: Won't Fix
        Status: Resolved  (was: Patch Available)

Due to limitation of fragmenting SyslogAppender message at 1024 bytes, this is no longer a
good approach to collect Hadoop metrics.

Deprecated by CHUKWA-546.


> Add ability to stream Hadoop metrics through syslog appender 
> -------------------------------------------------------------
>                 Key: CHUKWA-545
>                 URL:
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: data collection
>            Reporter: Eric Yang
>            Assignee: Eric Yang
>             Fix For: 0.5.0
>         Attachments: CHUKWA-545.patch
> Hadoop metrics is currently streaming through Chukwa's customized log4j appender to delegate
the registration of metrics file with Chukwa agent.  Both Chukwa agent and chukwa hadoop client
keeps track of list of registered adaptors.  It is error prone to have adaptor list tracked
in two different places.  In addition, the management of metrics files is also a problem.
 Hence, I propose to remove both limitation by using syslog appeender to send hadoop metrics
to Chukwa.  This approach eliminates the adaptor and file management problems.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message