spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jan (Jira)" <>
Subject [jira] [Created] (SPARK-30126) sparkContext.addFile fails when file path contains spaces
Date Wed, 04 Dec 2019 14:30:00 GMT
Jan created SPARK-30126:

             Summary: sparkContext.addFile fails when file path contains spaces
                 Key: SPARK-30126
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 2.4.3
            Reporter: Jan

When uploading a file to the spark context via the addFile function, an exception is thrown
when file path contains a space character. Escaping the space with %20 or \\ or + doesn't
change the result.


to reproduce: 

file_path = "/home/user/test dir/config.conf"



results in:

py4j.protocol.Py4JJavaError: An error occurred while calling o131.addFile.
: File file:/home/user/test%20dir/config.conf does not exist

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message