hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinayakumar B (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10115) Exclude duplicate jars in hadoop package under different component's lib
Date Mon, 09 Mar 2015 05:48:39 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352583#comment-14352583
] 

Vinayakumar B commented on HADOOP-10115:
----------------------------------------

Thanks [~aw]
Updated the patch.
{code}for childPath in "$src"/* ; do
child=$(basename "$childPath");{code}

Extracting the $child from the absolute path for comparing in both copy() and copyIfNotExists().
Hopefully remaining things works same.

bq. // we need to copy httpfs and kms as is
Thats a miss. Thanks for picking ;)

> Exclude duplicate jars in hadoop package under different component's lib
> ------------------------------------------------------------------------
>
>                 Key: HADOOP-10115
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10115
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 3.0.0, 2.2.0
>            Reporter: Vinayakumar B
>            Assignee: Vinayakumar B
>         Attachments: HADOOP-10115-004.patch, HADOOP-10115-005.patch, HADOOP-10115-006.patch,
HADOOP-10115.patch, HADOOP-10115.patch, HADOOP-10115.patch
>
>
> In the hadoop package distribution there are more than 90% of the jars are duplicated
in multiple places.
> For Ex:
> almost all jars in share/hadoop/hdfs/lib are already there in share/hadoop/common/lib
> Same case for all other lib in share directory.
> Anyway for all the daemon processes all directories are added to classpath.
> So to reduce the package distribution size and the classpath overhead, remove the duplicate
jars from the distribution.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message