hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Waldyn Benbenek (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6117) Hadoop ignores yarn.resourcemanager.hostname for RPC listeners
Date Thu, 02 Oct 2014 21:42:34 GMT
Waldyn Benbenek created MAPREDUCE-6117:
------------------------------------------

             Summary: Hadoop ignores yarn.resourcemanager.hostname for RPC listeners
                 Key: MAPREDUCE-6117
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6117
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: client, task
    Affects Versions: 2.5.1, 2.4.1, 2.2.1
         Environment: Any mapreduce example with standard cluster.  In our case each node
has four networks.  It is important that all internode communication be done on a specific
network.
            Reporter: Waldyn Benbenek


The RPC listeners for an application are using the hostname of the node as the binding address
of the listener,  They ignore yarn.resourcemanager.hostname for this.  In our setup we want
all communication between nodes to be done via the network addresses we specify in yarn.resourcemanager.hostname
on each node.  
TaskAttemptListenerImpl.java and MRClientService.java are two places I have found where the
default address is used rather that RM_host.   The resource Manager hostname should be used
for all communication between nodes including the RPC listeners.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message