giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-515) More efficient and flexible edge-based input
Date Sat, 16 Feb 2013 03:09:16 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13579690#comment-13579690
] 

Hudson commented on GIRAPH-515:
-------------------------------

Integrated in Giraph-trunk-Commit #711 (See [https://builds.apache.org/job/Giraph-trunk-Commit/711/])
    GIRAPH-515: GIRAPH-515: More efficient and flexible edge-based input (Revision 2123261537c3ccb041d067f5079533490db2d1ef)

     Result = SUCCESS
alessandro : http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=2123261537c3ccb041d067f5079533490db2d1ef
Files : 
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayEdges.java
* giraph-core/src/main/java/org/apache/giraph/comm/ServerData.java
* giraph-core/src/test/java/org/apache/giraph/utils/MockUtils.java
* giraph-core/src/test/java/org/apache/giraph/vertex/TestMultiGraphVertex.java
* giraph-core/src/main/java/org/apache/giraph/worker/EdgeInputSplitsCallable.java
* giraph-core/src/test/java/org/apache/giraph/vertex/TestMutableVertex.java
* giraph-core/src/main/java/org/apache/giraph/vertex/MultiGraphByteArrayVertex.java
* giraph-core/src/main/java/org/apache/giraph/benchmark/ByteArrayVertexPageRankBenchmark.java
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayVertexIdData.java
* giraph-core/src/main/java/org/apache/giraph/comm/SendEdgeCache.java
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayVertexIdEdges.java
* giraph-core/src/main/java/org/apache/giraph/utils/ByteArrayVertexIdMessages.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/RequestType.java
* giraph-core/src/main/java/org/apache/giraph/graph/EdgeStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/netty/NettyWorkerClientRequestProcessor.java
* giraph-core/src/main/java/org/apache/giraph/vertex/ByteArrayVertexBase.java
* giraph-core/src/main/java/org/apache/giraph/comm/SendCache.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendWorkerDataRequest.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendWorkerMessagesRequest.java
* giraph-core/src/main/java/org/apache/giraph/vertex/EdgeListVertex.java
* giraph-core/src/main/java/org/apache/giraph/vertex/ByteArrayVertex.java
* giraph-core/src/main/java/org/apache/giraph/partition/ByteArrayPartition.java
* giraph-core/src/main/java/org/apache/giraph/partition/DiskBackedPartitionStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/SendMessageCache.java
* giraph-core/src/main/java/org/apache/giraph/comm/messages/ByteArrayMessagesPerVertexStore.java
* giraph-core/src/main/java/org/apache/giraph/comm/netty/NettyWorkerServer.java
* giraph-core/src/test/java/org/apache/giraph/comm/RequestTest.java
* giraph-core/src/main/java/org/apache/giraph/worker/BspServiceWorker.java
* giraph-core/src/main/java/org/apache/giraph/benchmark/MultiGraphByteArrayVertexPageRankBenchmark.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java
* giraph-core/src/main/java/org/apache/giraph/comm/WorkerClientRequestProcessor.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java
* giraph-core/src/main/java/org/apache/giraph/utils/VertexIdIterator.java
* giraph-core/src/test/java/org/apache/giraph/comm/RequestFailureTest.java
* giraph-core/src/main/java/org/apache/giraph/comm/WorkerServer.java
* giraph-core/src/main/java/org/apache/giraph/conf/ImmutableClassesGiraphConfiguration.java
* giraph-core/src/main/java/org/apache/giraph/utils/WritableUtils.java
* giraph-core/src/main/java/org/apache/giraph/benchmark/PageRankBenchmark.java
* giraph-core/src/main/java/org/apache/giraph/comm/requests/SendWorkerEdgesRequest.java

                
> More efficient and flexible edge-based input
> --------------------------------------------
>
>                 Key: GIRAPH-515
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-515
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>         Attachments: GIRAPH-515.patch, GIRAPH-515.patch, GIRAPH-515.patch
>
>
> The current implementation of edge-based input using mutations is not as memory-efficient
as it could be, and also can't be used with immutable vertex classes.
> By having an ad-hoc code path for edges sent during input superstep, we can achieve both
memory efficiency and eliminate the current restriction.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message