hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Matei Zaharia (JIRA)" <j...@apache.org>
Subject [jira] Created: (MAPREDUCE-707) Provide a jobconf property for explicitly assigning a job to a pool
Date Sun, 05 Jul 2009 17:30:14 GMT
Provide a jobconf property for explicitly assigning a job to a pool
-------------------------------------------------------------------

                 Key: MAPREDUCE-707
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-707
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: contrib/fair-share
            Reporter: Matei Zaharia
            Priority: Trivial


A common use case of the fair scheduler is to have one pool per user, but then to define some
special pools for various production jobs, import jobs, etc. Therefore, it would be nice if
jobs went by default to the pool of the user who submitted them, but there was a setting to
explicitly place a job in another pool. Today, this can be achieved through a sort of trick
in the JobConf:

{code}
<property>
  <name>mapred.fairscheduler.poolnameproperty</name>
  <value>pool.name</value>
</property>

<property>
  <name>pool.name</name>
  <value>${user.name}</value>
</property>
{code}

This JIRA proposes to add a property called mapred.fairscheduler.pool that allows a job to
be placed directly into a pool, avoiding the need for this trick.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message