giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-579) Make it possible to use different out-edges data structures for input and computation
Date Wed, 27 Mar 2013 01:43:15 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13614789#comment-13614789
] 

Hudson commented on GIRAPH-579:
-------------------------------

Integrated in Giraph-trunk-Commit #851 (See [https://builds.apache.org/job/Giraph-trunk-Commit/851/])
    GIRAPH-579 (Revision 2430ec5f231f572b780dc0cb0053f409358df155)

     Result = SUCCESS
alessandro : http://git-wip-us.apache.org/repos/asf?p=giraph.git&a=commit&h=2430ec5f231f572b780dc0cb0053f409358df155
Files : 
* giraph-core/src/test/java/org/apache/giraph/io/TestEdgeInput.java
* giraph-core/src/main/java/org/apache/giraph/edge/EdgeStore.java
* giraph-core/src/main/java/org/apache/giraph/conf/ImmutableClassesGiraphConfiguration.java
* CHANGELOG
* giraph-core/src/main/java/org/apache/giraph/utils/InternalVertexRunner.java
* giraph-core/src/main/java/org/apache/giraph/utils/ConfigurationUtils.java
* giraph-core/src/main/java/org/apache/giraph/job/GiraphConfigurationValidator.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphClasses.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConfiguration.java
* giraph-core/src/main/java/org/apache/giraph/conf/GiraphConstants.java

                
> Make it possible to use different out-edges data structures for input and computation
> -------------------------------------------------------------------------------------
>
>                 Key: GIRAPH-579
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-579
>             Project: Giraph
>          Issue Type: New Feature
>            Reporter: Alessandro Presta
>            Assignee: Alessandro Presta
>         Attachments: GIRAPH-579.patch, GIRAPH-579.patch, GIRAPH-579.patch
>
>
> In some cases, the properties we want in the VertexEdges implementation during input
may differ from the ones we want during computation.
> Two examples:
> 1) During input, we want to keep only the top K edges according to weight, so we use
a fixed-size min-heap. During computation, our algorithm needs fast random access, so we use
a hash-map.
> 2) We have a VertexEdges implementation that's optimized for space and/or iteration speed,
but has slow insertion. We can then use a different data structure that has fast insertion
during input.
> We can add an option to specify a different VertexEdges class to be used in EdgeStore
during input.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message