hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "KWON BYUNGCHANG (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6668) AM of no uber job does not need local resources.
Date Mon, 04 Apr 2016 07:57:25 GMT
KWON BYUNGCHANG created MAPREDUCE-6668:
------------------------------------------

             Summary: AM of no uber job does not need local resources.
                 Key: MAPREDUCE-6668
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6668
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: mr-am
            Reporter: KWON BYUNGCHANG
            Assignee: KWON BYUNGCHANG
            Priority: Minor


if specify {{-libjar}} {{-files}} {{-archive}} on command line or set below properties

{code}
mapreduce.job.cache.archives
mapreduce.job.cache.files.filesizes
{code}

MapReduce framework will configure  {{LocalResources}} for map/reduce container.   also configure
for ApplicationMaster.

if job is not uber, ApplicationMaster does not need {{LocalResources}}.
Deploying localResource for AM will cause slowly launching AM.

I make a proposal:  if job is not uber,  map-reduce client does not configure localResource
for AM.  obviously must configure for map/reduce container.

 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message