giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Claudio Martella (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-515) More efficient and flexible edge-based input
Date Thu, 14 Feb 2013 23:15:13 GMT


Claudio Martella commented on GIRAPH-515:

Totally agree, I discussed the same issue in the document I sent you weeks ago. Decoupling
it would be much better also to write back e.g. only new or modified edges and/or vertex values,
instead of the whole thing (how to do it seek-free is to be seen though).

The decoupling though does not come for free. Now you can implement your best serialization/deserialization
for your own vertex representation, for a given algorithm. hiding it from the user but still
allowing for optimization can be tricky in practice.
> More efficient and flexible edge-based input
> --------------------------------------------
>                 Key: GIRAPH-515
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>         Attachments: GIRAPH-515.patch
> The current implementation of edge-based input using mutations is not as memory-efficient
as it could be, and also can't be used with immutable vertex classes.
> By having an ad-hoc code path for edges sent during input superstep, we can achieve both
memory efficiency and eliminate the current restriction.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message