hadoop-yarn-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Biju N <bijuatapa...@gmail.com>
Subject Configuring Fair scheduler
Date Tue, 03 Feb 2015 23:30:03 GMT
*Environment: *hadoop version 2.6 / Ubuntu

I am trying to run the map reduce example program "pi" on a cluster with
one RM and one NM. The nodes are VMs with 4 processors and 4 MB memory and
the hypervisor hosting the VMs have 8 cores and 16 GB memory. When I run
the job with the following properties in yarn-site.xml the job doesn't get
scheduled. But when the "memory-mb" property is changed to 4096 ( which is
the total memory on the node ) the job completes successfully. Note that
this properties works fine in hadoop 2.2. Also only the default queue is
used and this is the only job on the cluster.





The question is what is the calculation which need to be used to set the
following properties in yarn-site.xml


Also how to derive the values for the following properties in the

    <minResources>nnn mb,0vcores</minResources>
    <maxResources>nnn mb,2vcores</maxResources>

Any help on this is much appreciated.


  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message