giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dionysios Logothetis (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (GIRAPH-1034) Allow IPs for Worker2Worker communication
Date Thu, 17 May 2018 06:38:00 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Dionysios Logothetis resolved GIRAPH-1034.
------------------------------------------
    Resolution: Fixed

> Allow IPs for Worker2Worker communication
> -----------------------------------------
>
>                 Key: GIRAPH-1034
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-1034
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Sergey Edunov
>            Assignee: Sergey Edunov
>            Priority: Major
>
> For worker2worker communication, we use O(n^2) DNS lookups, where n is the number of
workers. If network infrastructure is less reliable, combined with a large number of workers,
these DNS lookups occasionally fail. 
> Fortunately, we don't always need DNS lookups, as in many clusters hosts can communicate
with each other directly using IP addresses. Let's add a configuration option to use IP address
instead of the host name. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message