giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Claudio Martella (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-515) More efficient and flexible edge-based input
Date Thu, 14 Feb 2013 23:15:13 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13578797#comment-13578797
] 

Claudio Martella commented on GIRAPH-515:
-----------------------------------------

Totally agree, I discussed the same issue in the document I sent you weeks ago. Decoupling
it would be much better also to write back e.g. only new or modified edges and/or vertex values,
instead of the whole thing (how to do it seek-free is to be seen though).

The decoupling though does not come for free. Now you can implement your best serialization/deserialization
for your own vertex representation, for a given algorithm. hiding it from the user but still
allowing for optimization can be tricky in practice.
                
> More efficient and flexible edge-based input
> --------------------------------------------
>
>                 Key: GIRAPH-515
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-515
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>         Attachments: GIRAPH-515.patch
>
>
> The current implementation of edge-based input using mutations is not as memory-efficient
as it could be, and also can't be used with immutable vertex classes.
> By having an ad-hoc code path for edges sent during input superstep, we can achieve both
memory efficiency and eliminate the current restriction.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message