hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Wang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-11804) POC Hadoop Client w/o transitive dependencies
Date Tue, 01 Nov 2016 17:35:59 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-11804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626097#comment-15626097
] 

Andrew Wang commented on HADOOP-11804:
--------------------------------------

Thanks for the quick response Sean,

bq. I'm confused about test protobuf classes showing up in the client-api jar...

Yea, this was a mystery to me too. Could be PEBKAC, in which case I'd appreciate fuller build
instructions.

bq. I think the answer for the logging libraries and htrace is to leave them unshaded, since
it's common to want to modify logging settings and to want to trace through e.g. the hdfs
client. Would like some feedback here.

The logging rationale here sounds good to me. We've been trying to migrate things to slf4j,
but evidently we haven't made much progress.

Unshading HTrace also sounds good, since I'm guessing that shading will mess up tracing from
an app into the Hadoop client. [~cmccabe] care to comment more authoritatively?

> POC Hadoop Client w/o transitive dependencies
> ---------------------------------------------
>
>                 Key: HADOOP-11804
>                 URL: https://issues.apache.org/jira/browse/HADOOP-11804
>             Project: Hadoop Common
>          Issue Type: Sub-task
>          Components: build
>            Reporter: Sean Busbey
>            Assignee: Sean Busbey
>         Attachments: HADOOP-11804.1.patch, HADOOP-11804.2.patch, HADOOP-11804.3.patch,
HADOOP-11804.4.patch
>
>
> make a hadoop-client-api and hadoop-client-runtime that i.e. HBase can use to talk with
a Hadoop cluster without seeing any of the implementation dependencies.
> see proposal on parent for details.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message