giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dionysios Logothetis (JIRA)" <>
Subject [jira] [Resolved] (GIRAPH-1034) Allow IPs for Worker2Worker communication
Date Thu, 17 May 2018 06:38:00 GMT


Dionysios Logothetis resolved GIRAPH-1034.
    Resolution: Fixed

> Allow IPs for Worker2Worker communication
> -----------------------------------------
>                 Key: GIRAPH-1034
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Sergey Edunov
>            Assignee: Sergey Edunov
>            Priority: Major
> For worker2worker communication, we use O(n^2) DNS lookups, where n is the number of
workers. If network infrastructure is less reliable, combined with a large number of workers,
these DNS lookups occasionally fail. 
> Fortunately, we don't always need DNS lookups, as in many clusters hosts can communicate
with each other directly using IP addresses. Let's add a configuration option to use IP address
instead of the host name. 

This message was sent by Atlassian JIRA

View raw message