spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Dongjoon Hyun (Jira)" <>
Subject [jira] [Updated] (SPARK-30256) Allow SparkLauncher to sudo before executing spark-submit
Date Mon, 16 Mar 2020 22:53:03 GMT


Dongjoon Hyun updated SPARK-30256:
    Affects Version/s:     (was: 3.0.0)

> Allow SparkLauncher to sudo before executing spark-submit
> ---------------------------------------------------------
>                 Key: SPARK-30256
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Submit
>    Affects Versions: 3.1.0
>            Reporter: Jeff Evans
>            Priority: Minor
> It would be useful if {{org.apache.spark.launcher.SparkLauncher}} allowed for a "sudo
as user X" option.  This way, multi-tenant applications that run Spark jobs could give end
users greater security, by ensuring that the files (including, importantly, keytabs) can remain
readable only by the end users instead of the UID that runs this multi-tenant application
itself.  I believe that {{sudo -u <theUser> spark-submit <spark-submit-args>}}
should work.  The builder maintained by {{SparkLauncher}} could simply have a {{setSudoUser}}

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message