hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suraj Menon <surajsme...@apache.org>
Subject Re: How to load pre-partitioned data separately?
Date Wed, 15 Aug 2012 12:03:20 GMT

Sorry, you would go through a re-partitioning at runtime today. I consulted
Thomas and I think we can get this fixed in the next release.
The next release would be made between end of this month and mid next month.


On Tue, Aug 14, 2012 at 4:54 AM, Bo Locker <locker.fighter@gmail.com> wrote:

> Hello,
> I want to use hama in large graph processing, but here comes the problem:
> the graph data is pre-partitioned and I want each groom gets its own part.
> The data looks like following:
> 1 2
> 1 3
> 2 3
> 2 4
> 3 4
> ...
> Each line represents an edge in the graph. We pre-partition the graph into
> several parts and each groom holds one part.
> I wonder if this problem could be fixed. How could i deal with it? Should I
> load the data first, then let each groom get its own part by communication,
> or should I use the Partition class? Some suggestions must be appreciated.
> Thank you...
> ps. The graph data is extremely large, about 10 billion nodes.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message