flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-4297) Yarn client can't determine fat jar location if path contains spaces
Date Mon, 01 Aug 2016 13:40:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15402040#comment-15402040
] 

ASF GitHub Bot commented on FLINK-4297:
---------------------------------------

GitHub user mxm opened a pull request:

    https://github.com/apache/flink/pull/2320

    [FLINK-4297][yarn] decode URL encoded fat jar path

    This solves problems with spaces and special characters in the
    automatically determined fat jar path which is returned URL encoded.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mxm/flink FLINK-4297

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/2320.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2320
    
----
commit 76dc43ac69e374482894fa15d67f001fc5030be0
Author: Maximilian Michels <mxm@apache.org>
Date:   2016-08-01T13:19:15Z

    [FLINK-4297][yarn] decode URL encoded fat jar path
    
    This solves problems with spaces and special characters in the
    automatically determined fat jar path which is returned URL encoded.

----


> Yarn client can't determine fat jar location if path contains spaces
> --------------------------------------------------------------------
>
>                 Key: FLINK-4297
>                 URL: https://issues.apache.org/jira/browse/FLINK-4297
>             Project: Flink
>          Issue Type: Bug
>          Components: YARN Client
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>             Fix For: 1.1.0, 1.2.0
>
>
> The code that automatically determines the fat jar path through the ProtectionDomain
of the Yarn class, receives a possibly URL encoded path string. We need to decode using the
system locale encoding, otherwise we can receive errors of the following when spaces are in
the file path: 
> {noformat}
> Caused by: java.io.FileNotFoundException: File file:/Users/max/Downloads/release-testing/flink-1.1.0-rc1/flink-1.1.0/build%20target/lib/flink-dist_2.11-1.1.0.jar
does not exist
>         at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:511)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:724)
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:501)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:397)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:337)
>         at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
>         at org.apache.hadoop.fs.LocalFileSystem.copyFromLocalFile(LocalFileSystem.java:82)
>         at org.apache.hadoop.fs.FileSystem.copyFromLocalFile(FileSystem.java:1836)
>         at org.apache.flink.yarn.Utils.setupLocalResource(Utils.java:129)
>         at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deployInternal(AbstractYarnClusterDescriptor.java:616)
>         at org.apache.flink.yarn.AbstractYarnClusterDescriptor.deploy(AbstractYarnClusterDescriptor.java:365)
>         ... 6 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message