spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jan (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-30126) sparkContext.addFile fails when file path contains spaces
Date Wed, 04 Dec 2019 14:30:00 GMT
Jan created SPARK-30126:
---------------------------

             Summary: sparkContext.addFile fails when file path contains spaces
                 Key: SPARK-30126
                 URL: https://issues.apache.org/jira/browse/SPARK-30126
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 2.4.3
            Reporter: Jan


When uploading a file to the spark context via the addFile function, an exception is thrown
when file path contains a space character. Escaping the space with %20 or \\ or + doesn't
change the result.

 

to reproduce: 

file_path = "/home/user/test dir/config.conf"

sparkContext.addFile(file_path)

 

results in:

py4j.protocol.Py4JJavaError: An error occurred while calling o131.addFile.
: java.io.FileNotFoundException: File file:/home/user/test%20dir/config.conf does not exist



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message