mrunit-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dave Beech (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MRUNIT-161) some distributed cache apis not working - JobContext getCacheArchives()
Date Mon, 26 Nov 2012 11:48:58 GMT

    [ https://issues.apache.org/jira/browse/MRUNIT-161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13503743#comment-13503743
] 

Dave Beech commented on MRUNIT-161:
-----------------------------------

the getLocal* methods are what the user would call in a mapper or reducer class to access
the cache files that have been "localized". That's to say, copied to local disk into the task's
working area by the mapreduce framework. 

We do set the "local" files in mrunit - it's done in TestDriver's initDistributedCache method.

I'll take a look at the patch later - thanks Brock. 
                
> some distributed cache apis not working - JobContext getCacheArchives()
> -----------------------------------------------------------------------
>
>                 Key: MRUNIT-161
>                 URL: https://issues.apache.org/jira/browse/MRUNIT-161
>             Project: MRUnit
>          Issue Type: Bug
>    Affects Versions: 1.0.0
>            Reporter: Patrick Hunt
>            Priority: Blocker
>             Fix For: 1.0.0
>
>         Attachments: MRUNIT-161-0.patch
>
>
> I'm using the new MRUnit method withCacheArchive available in 1.0.0.
> DistributedCache.getLocalCacheArchives(conf) returns a non-empty array, however
> org.apache.hadoop.mapreduce.JobContext.getCacheArchives()
> in the mapper returns null. It seems that the context mock doesn't have these methods
implemented?
> I'm using hadoop2, where getLocalCacheArchives is listed as deprecated.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message