Message view | « Date » · « Thread » |
---|---|
Top | « Date » · « Thread » |
From | Wang <414azuir...@gmail.com> |
Subject | Can I use Yarn to dynamically assign nodes for map reduce tasks? |
Date | Thu, 05 Jun 2014 17:58:42 GMT |
Hi, All, When I use Hadoop for executing the Map reduce tasks, I am unable to find the API to allow me assign the compute nodes for executing the task. For example, if I have 10 compute nodes, I want the nodes 1~5 to execute task 1, and nodes 6~10 to execute task 2. Is there any simple way to let Resource manager distribute the tasks with my customized scheme? Thanks in Advance! Best, Clarence | |
Mime |
|
View raw message |