spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Felix Cheung (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-24326) Add local:// scheme support for the app jar in mesos cluster mode
Date Fri, 01 Jun 2018 04:27:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-24326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Felix Cheung resolved SPARK-24326.
----------------------------------
       Resolution: Fixed
         Assignee: Stavros Kontopoulos
    Fix Version/s: 2.4.0

>  Add local:// scheme support for the app jar in mesos cluster mode
> ------------------------------------------------------------------
>
>                 Key: SPARK-24326
>                 URL: https://issues.apache.org/jira/browse/SPARK-24326
>             Project: Spark
>          Issue Type: Improvement
>          Components: Mesos
>    Affects Versions: 2.3.0
>            Reporter: Stavros Kontopoulos
>            Assignee: Stavros Kontopoulos
>            Priority: Major
>             Fix For: 2.4.0
>
>
> It is often useful to reference an application jar within the image used to deploy a
Spark job on mesos in cluster mode. This is not possible right now because the mesos dispatcher
will try to resolve the local://... uri on the host (via the fetcher) and not in the container.
Target is to have a scheme like local:/// being resolved in the container's fs.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message