giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-1019) Optimizing and debugging vertex mutation
Date Mon, 06 Jul 2015 18:34:04 GMT


Hudson commented on GIRAPH-1019:

FAILURE: Integrated in Giraph-trunk-Commit #1556 (See [])
[GIRAPH-1019] Optimizing and debugging vertex mutation mechanism (aching:
* giraph-core/src/main/java/org/apache/giraph/comm/netty/
* giraph-examples/src/test/java/org/apache/giraph/
* giraph-core/src/main/java/org/apache/giraph/comm/requests/
* giraph-core/src/main/java/org/apache/giraph/graph/
* giraph-core/src/test/java/org/apache/giraph/comm/
* giraph-core/src/main/java/org/apache/giraph/comm/netty/
* giraph-core/src/main/java/org/apache/giraph/comm/
* giraph-examples/src/main/java/org/apache/giraph/examples/
* giraph-core/src/main/java/org/apache/giraph/comm/
* giraph-core/src/main/java/org/apache/giraph/graph/

> Optimizing and debugging vertex mutation
> ----------------------------------------
>                 Key: GIRAPH-1019
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>          Components: graph
>            Reporter: Hassan Eslami
>            Assignee: Hassan Eslami
>              Labels: core, migration, multi-threading
>   Original Estimate: 48h
>  Remaining Estimate: 48h
> Currently vertex mutations happen while preparing a superstep execution in a single-threaded
manner. This is extremely inefficient specially for the case of out-of-core as we have to
go over all the partitions, load them, and test if they have any applicable mutation. Also,
there is an unexpected behavior in cases where a mutation happen to a vertex and some messages
being delivered to that vertex at the same time (current implementation fails the job in that
> In order to fix/optimize this, mutations should happen in a multi-threaded fashion right
before start of processing of a partition. Also, while partition migration happens, mutation
requests should migrate along with the partition and its messages.

This message was sent by Atlassian JIRA

View raw message