giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GIRAPH-198) running Giraph trunk on Hadoop 2.0.0-alpha leads to an exception
Date Tue, 05 Jun 2012 10:02:23 GMT

    [ https://issues.apache.org/jira/browse/GIRAPH-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289293#comment-13289293
] 

Andrew Purtell commented on GIRAPH-198:
---------------------------------------

Does this look like HDFS-2739?

Why is the old Hadoop RPC being used instead of the new Netty based RPC? Maybe it's something
simple we are missing like a system property define on the 'hadoop jar' commandline?
                
> running Giraph trunk on Hadoop 2.0.0-alpha leads to an exception
> ----------------------------------------------------------------
>
>                 Key: GIRAPH-198
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-198
>             Project: Giraph
>          Issue Type: Bug
>          Components: mapreduce
>    Affects Versions: 0.2.0
>            Reporter: Roman Shaposhnik
>            Assignee: Jakob Homan
>             Fix For: 0.2.0
>
>
> Here's how we compile:
> {noformat}
> $ mvn -Phadoop_trunk -DskipTests -Dhadoop.version=2.0.0-alpha site package
> {noformat}
> Here's how we run:
> {noformat}
> $ export GIRAPH_HOME=/usr/lib/giraph 
> $ hadoop jar /usr/lib/giraph/giraph-jar-with-dependencies.jar org.apache.giraph.benchmark.PageRankBenchmark
-e 1 -s 3 -V 100000 -w 3
> {noformat}
> Here's what we get in the task logs (as a side note -- once 3 of the 8 tasks fail that
way the entire job hangs forever which could be a bug in and of itself):
> {noformat}
> 2012-05-31 10:31:28,518 WARN [main]
> org.apache.hadoop.mapred.YarnChild: Exception running child :
> java.lang.RuntimeException: java.lang.NoSuchFieldException: versionID
>        at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:170)
>        at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.(WritableRpcEngine.java:110)
>        at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:224)
>        at $Proxy11.putVertexList(Unknown Source)
>        at org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:921)
>        at org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:322)
>        at org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:594)
>        at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:473)
>        at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:645)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
>        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
>        at java.security.AccessController.doPrivileged(Native Method)
>        at javax.security.auth.Subject.doAs(Subject.java:396)
>        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
>        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
> Caused by: java.lang.NoSuchFieldException: versionID
>        at java.lang.Class.getField(Class.java:1520)
>        at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:166)
>        ... 15 more
> {noformat}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message