hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15566) Remove HTrace support
Date Mon, 23 Jul 2018 17:26:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16553144#comment-16553144

stack commented on HADOOP-15566:

For me, the hard part is not which tracing lib to use -- if a tracing lib discussion, lets
do it out on dev? We should also invite others to the discussion -- but rather discussion
around resourcing:

 * Ensuring traces tell a good narrative across the different code paths and over processes,
and that trace paths remain intact across code churn; they are brittle and easily broken/disconnected
as dev goes on.
* Instrumenting/coverage -- inserting trace points is time consuming whose value is only realized
down-the-road by operator/dev trying to figure a slowdown (so the https://github.com/opentracing-contrib/java-tracerresolver
looks interesting).
* Tooling to enable tracing and visualize needs to be easy-to-deploy and use else all will
go to rot (Some orgs trace every transaction with a simple switch for dumping to visualizer
that is up and always available..)
* Ensuring traces are friction-free else they'll be removed or not taken-on in the first place.
* Evangelizing and pushing trace across hadoop components; the more components instrumented,
the more we all will benefit.


> Remove HTrace support
> ---------------------
>                 Key: HADOOP-15566
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15566
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: metrics
>    Affects Versions: 3.1.0
>            Reporter: Todd Lipcon
>            Priority: Major
>         Attachments: Screen Shot 2018-06-29 at 11.59.16 AM.png, ss-trace-s3a.png
> The HTrace incubator project has voted to retire itself and won't be making further releases.
The Hadoop project currently has various hooks with HTrace. It seems in some cases (eg HDFS-13702)
these hooks have had measurable performance overhead. Given these two factors, I think we
should consider removing the HTrace integration. If there is someone willing to do the work,
replacing it with OpenTracing might be a better choice since there is an active community.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message