spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marcelo Vanzin (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-10766) Add some configurations for the client process in yarn-cluster mode.
Date Tue, 12 Feb 2019 20:48:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marcelo Vanzin resolved SPARK-10766.
------------------------------------
    Resolution: Not A Problem

There's a bunch of config options already with the {{spark.yarn.am.}} prefix.

> Add some configurations for the client process in yarn-cluster mode. 
> ---------------------------------------------------------------------
>
>                 Key: SPARK-10766
>                 URL: https://issues.apache.org/jira/browse/SPARK-10766
>             Project: Spark
>          Issue Type: Improvement
>          Components: YARN
>    Affects Versions: 1.6.0
>            Reporter: carlmartin
>            Priority: Major
>
> In the yarn-cluster mode, it's hard to find the correct configuration for the client
process. 
> But this is necessary such as the client process's class path: if I want to use hbase
on spark, I have to include the hbase jars into client's classpath.
> But *spark.driver.extraClassPath* can't take effect. The way I can do is set the hbase
jars into the Enviroment of SPARK_CLASSPATH. 
> It isn't a better way so I want to add some configuration for this client process.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message