spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-683) Spark 0.7 with Hadoop 1.0 does not work with current AMI's HDFS installation
Date Wed, 29 Oct 2014 09:17:33 GMT

    [ https://issues.apache.org/jira/browse/SPARK-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14188160#comment-14188160
] 

Sean Owen commented on SPARK-683:
---------------------------------

PS I think this also turns out to be the same as SPARK-4078

> Spark 0.7 with Hadoop 1.0 does not work with current AMI's HDFS installation
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-683
>                 URL: https://issues.apache.org/jira/browse/SPARK-683
>             Project: Spark
>          Issue Type: Bug
>          Components: EC2
>    Affects Versions: 0.7.0
>            Reporter: Tathagata Das
>
> A simple saveAsObjectFile() leads to the following error.
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.NoSuchMethodException:
org.apache.hadoop.hdfs.protocol.ClientProtocol.create(java.lang.String, org.apache.hadoop.fs.permission.FsPermission,
java.lang.String, boolean, boolean, short, long)
> 	at java.lang.Class.getMethod(Class.java:1622)
> 	at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:557)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
> 	at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:416)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> 	at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message