giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hassan Eslami (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-1027) Improve flow-control on sender side
Date Fri, 07 Aug 2015 18:20:46 GMT


Hassan Eslami commented on GIRAPH-1027:

Code review discussion:

> Improve flow-control on sender side
> -----------------------------------
>                 Key: GIRAPH-1027
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>          Components: graph
>            Reporter: Hassan Eslami
>            Assignee: Hassan Eslami
> Currently, a sender worker will keep all open requests (and optionally up to a certain
number of total open requests) in its own memory. This behavior may cause high memory usage
in sender side. Also, since messages can arrive to a worker at an arbitrary rate, receiver
may not have the ability to handle all incoming messages, hence we may see a large memory
footprint in receiver as well. This diff addresses the problem by limiting the number of open
requests per worker in sender side. Also, it provides a cache of unsent requests on sender
in case the sender already sent enough messages to another worker but has not received any
response back.

This message was sent by Atlassian JIRA

View raw message