giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pavan Kumar (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-908) support for partitioned input in giraph
Date Wed, 04 Jun 2014 15:15:02 GMT


Pavan Kumar commented on GIRAPH-908:

Also put it on review board

> support for partitioned input in giraph
> ---------------------------------------
>                 Key: GIRAPH-908
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Pavan Kumar
>            Assignee: Pavan Kumar
>         Attachments: GIRAPH-908.patch
> When the graph we need to work on is already partitioned into a fixed number of buckets,
with properties such as high edge-locality, low fan-out to other buckets, etc.  [for instance
using techniques such as ]
> we should be able to partition our graph based on such a mapping, to improve local-requests,
etc. thus avoiding huge network communication. this diff is especially useful we repeatedly
run algorithms on top of the same graph. In such case, we can compute the partitioning once
& then use it to speed up processing, (also requiring less network bandwidth, etc.) for
the rest applications on same/ similar graphs.
> The diff is big & partly reviewed by my colleagues. Putting it up for review

This message was sent by Atlassian JIRA

View raw message