flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-1789) Allow adding of URLs to the usercode class loader
Date Fri, 24 Apr 2015 09:28:39 GMT

    [ https://issues.apache.org/jira/browse/FLINK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510710#comment-14510710

ASF GitHub Bot commented on FLINK-1789:

Github user StephanEwen commented on the pull request:

    I think that keeping the classpaths in sync is really crucial. What is the problem in
exposing this to the client as well?
    Can we make the following assumptions for the use case where we need the global class
      - The URL is either a file path that points to a directory accessible to all nodes (NFS
or so) and the client runs in the cluster as well.
      - The URL is an HTTP URL or so that points to a file server that serves the classes
to work in non-shared directory settings.
    Some other remark: This makes the code quite dirty on a lot of parts, since we have always
Files and URLs in Client, executors, ... Can we not store everything as URLs (rather than
having Strings for jar files and URLs extra). Files can be expressed as URLs anyways as well...

> Allow adding of URLs to the usercode class loader
> -------------------------------------------------
>                 Key: FLINK-1789
>                 URL: https://issues.apache.org/jira/browse/FLINK-1789
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Runtime
>            Reporter: Timo Walther
>            Assignee: Timo Walther
>            Priority: Minor
> Currently, there is no option to add customs classpath URLs to the FlinkUserCodeClassLoader.
JARs always need to be shipped to the cluster even if they are already present on all nodes.
> It would be great if RemoteEnvironment also accepts valid classpaths URLs and forwards
them to BlobLibraryCacheManager.

This message was sent by Atlassian JIRA

View raw message