giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eli Reisman (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-515) More efficient and flexible edge-based input
Date Fri, 15 Feb 2013 23:19:13 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13579589#comment-13579589
] 

Eli Reisman commented on GIRAPH-515:
------------------------------------

@alessandro: above when you mentioned the big PR job with Hive input, could you give an order
of magnitude ballpark of how many V's and E's in that data? And you said 40GB each worker
was generous, but how many workers? If you can't say, thats fine too just curious.
                
> More efficient and flexible edge-based input
> --------------------------------------------
>
>                 Key: GIRAPH-515
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-515
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>         Attachments: GIRAPH-515.patch, GIRAPH-515.patch
>
>
> The current implementation of edge-based input using mutations is not as memory-efficient
as it could be, and also can't be used with immutable vertex classes.
> By having an ad-hoc code path for edges sent during input superstep, we can achieve both
memory efficiency and eliminate the current restriction.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message