spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-6355) Spark standalone cluster does not support local:/ url for jar file
Date Mon, 16 Mar 2015 11:23:38 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14363084#comment-14363084
] 

Sean Owen commented on SPARK-6355:
----------------------------------

Is {{local}} a valid URI scheme? I hadn't seen that before. Do you just mean {{file:}}?
Maybe you could show what command you are running. I'm not clear what URI you are passing.

> Spark standalone cluster does not support local:/ url for jar file
> ------------------------------------------------------------------
>
>                 Key: SPARK-6355
>                 URL: https://issues.apache.org/jira/browse/SPARK-6355
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 1.3.0, 1.2.1
>            Reporter: Jesper Lundgren
>
> Submitting a new spark application to a standalone cluster with local:/path will result
in an exception.
> Driver successfully submitted as driver-20150316171157-0004
> ... waiting before polling master for driver state
> ... polling master for driver state
> State of driver-20150316171157-0004 is ERROR
> Exception from cluster was: java.io.IOException: No FileSystem for scheme: local
> java.io.IOException: No FileSystem for scheme: local
> 	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2584)
> 	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
> 	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
> 	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
> 	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
> 	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
> 	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296)
> 	at org.apache.spark.deploy.worker.DriverRunner.org$apache$spark$deploy$worker$DriverRunner$$downloadUserJar(DriverRunner.scala:141)
> 	at org.apache.spark.deploy.worker.DriverRunner$$anon$1.run(DriverRunner.scala:75)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message