chukwa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sourygna Luangsay (JIRA)" <>
Subject [jira] [Commented] (CHUKWA-664) network compression between agent and collector
Date Sat, 15 Sep 2012 10:15:07 GMT


Sourygna Luangsay commented on CHUKWA-664:

Here is a first patch that adds the compression feature. I have tried it with DefaultCodec,
GzipCodec, BZip2Codec and it seems OK.
If it looks good, I'll submit another patch with the current changes in the documentation.

Though everything seems to work, there is something that I don't really understand. I have
tcpdumped network traffic and when compression is enabled, I can't see any more the HTTP POST
protocol appearing in Wireshark. I just see various TCP segments that hold my Chukwa chunk,
but I can't see any higher protocol than TCP. What is more, using the same file (19KB) to
compare between compress (size compress: 7.6 KB) and uncompressed tcpdumps, I have noticed
that I get more (smaller) TCP segments with compressed communication than with uncompressed
communication. Could someone enlightens me?
> network compression between agent and collector
> -----------------------------------------------
>                 Key: CHUKWA-664
>                 URL:
>             Project: Chukwa
>          Issue Type: New Feature
>          Components: Data Collection
>    Affects Versions: 0.5.0, 0.6.0
>            Reporter: Sourygna Luangsay
>            Priority: Trivial
>             Fix For: 0.6.0
>         Attachments: chukwa-664.patch
> As suggested in$13d9c100$3b8d4300$@com%3E
, Chukwa should be able to compress network communications between agent and collector.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message