giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Avery Ching (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-76) Refactor worker logic from GraphMapper
Date Thu, 28 Jun 2012 08:33:44 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402932#comment-13402932
] 

Avery Ching commented on GIRAPH-76:
-----------------------------------

Good start!

So for this (anyone else, please correct me if I'm wrong), I believe the goal is to pull everything
out of the map method into something else to make it easier for using something like YARN
to be able to run the framework outside of Hadoop.

Btw, perhaps PartitionRunner makes more sense (not creating an object per vertex).  Also,
I would think about making it open toward supporting multi-threading in the future.  I had
a patch for multithreading, but it was a little...unclean =).
                
> Refactor worker logic from GraphMapper
> --------------------------------------
>
>                 Key: GIRAPH-76
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-76
>             Project: Giraph
>          Issue Type: Improvement
>          Components: graph
>            Reporter: Jakob Homan
>            Assignee: Alessandro Presta
>         Attachments: Refactor_worker_logic_from_GraphMapper.patch
>
>
> The plumbing around executing vertices is hosted within the mapper, but could be extracted
to its own class and executed from the Mapper directly.  This would ease testing and make
it easier to host in the new YARN infrastructure.  There's nothing mapper specific about this
code.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message