hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allen Wittenauer (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-752) DistributedCache.addArchiveToClassPath doesn't work
Date Wed, 23 Jul 2014 19:19:40 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Allen Wittenauer resolved MAPREDUCE-752.

    Resolution: Fixed

The reality was that 0.21 did come out but no one really used it. 0.20 had this issue forever
until 0.20.2xx came out.  

Closing, grumpily, as fixed.

> DistributedCache.addArchiveToClassPath doesn't work
> ---------------------------------------------------
>                 Key: MAPREDUCE-752
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-752
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distributed-cache
>    Affects Versions: 0.20.1, 0.21.0
>            Reporter: Vladimir Klimontovich
>         Attachments: MAPREDUCE-752-ver2.patch, MAPREDUCE-752-ver3.patch, MAPREDUCE-752.patch,
> addArchiveToClassPath is a method of DistributedCache class. It should be called before
running a task. It accepts path to a jar file on a DFS. After it
> this method should put this jar file on sitribuuted cache and than add this file to classpath
to each map/reduce process on job tracker. 
> This method don't work:
> in TaskRunner there is an algorithm that looks for correspondence between DFS paths and
local paths in distributed cache.
> It compares
> if (archives[i].getPath().equals(
> archiveClasspaths[j].toString())){
> instead of
> if (archives[i].toString().equals(
> archiveClasspaths[j].toString())) 

This message was sent by Atlassian JIRA

View raw message