hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ben Sigelman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-15566) Remove HTrace support
Date Mon, 23 Jul 2018 14:02:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-15566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16552907#comment-16552907

Ben Sigelman commented on HADOOP-15566:

[~elek] the projects have similar goals but take different approaches. OpenTracing's surface
area is intentionally "as narrow as possible" which means that it brings in almost no dependencies
(OpenCensus is more of a fully-featured "agent" model, which necessarily gives it a larger
footprint). OpenTracing also makes no assumptions about the serialization formats (or
header names, etc) between peered processes in the distributed system/application, or the
serialization format of the tracing system itself. This means that OpenTracing instrumentation
can be used/reused for a wider variety of things: straightforward distributed trace collectors/indexers/viewers
like Zipkin, Jaeger, etc, but also distributed debuggers, security applications, and so forth.

Also, building a general-purpose adapter to convert OpenTracing instrumentation into OpenCensus
API calls would be straightforward (due to the relative "thickness" and numbers of implementation
assumptions made in each project). Going the other way would be challenging or impossible,
depending on reliance on OpenCensus wire formats.

> Remove HTrace support
> ---------------------
>                 Key: HADOOP-15566
>                 URL: https://issues.apache.org/jira/browse/HADOOP-15566
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: metrics
>    Affects Versions: 3.1.0
>            Reporter: Todd Lipcon
>            Priority: Major
>         Attachments: Screen Shot 2018-06-29 at 11.59.16 AM.png, ss-trace-s3a.png
> The HTrace incubator project has voted to retire itself and won't be making further releases.
The Hadoop project currently has various hooks with HTrace. It seems in some cases (eg HDFS-13702)
these hooks have had measurable performance overhead. Given these two factors, I think we
should consider removing the HTrace integration. If there is someone willing to do the work,
replacing it with OpenTracing might be a better choice since there is an active community.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message