spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prashant Sharma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-25065) Provide a way to add a custom logging configuration file.
Date Thu, 09 Aug 2018 07:37:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-25065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574414#comment-16574414
] 

Prashant Sharma commented on SPARK-25065:
-----------------------------------------

One work around is to edit Dockerfile and copy logging configuration to any other another
directory than conf, and then point to the logging configuration by using
{noformat}
spark.(executor|driver).extraJavaOptions{noformat}
properties to something as follows(in case of log4j).
{noformat}
-Dlog4j.configuration=file:///path/on/image{noformat}
 

> Provide a way to add a custom logging configuration file.
> ---------------------------------------------------------
>
>                 Key: SPARK-25065
>                 URL: https://issues.apache.org/jira/browse/SPARK-25065
>             Project: Spark
>          Issue Type: Improvement
>          Components: Kubernetes
>    Affects Versions: 2.3.1
>            Reporter: Prashant Sharma
>            Priority: Major
>
> Currently, when running in kubernetes mode, it sets necessary configuration properties
by creating a spark.properties file and mounting a conf dir.
> The shipped Dockerfile, do not copy conf to the image, and this is on purpose and that
is well understood. However, one would like to have his custom logging configuration file
in the image conf directory.
> In order to achieve this, it is not enough to copy it in the spark's conf dir of the
resultant image, as it is reset during kubernetes mount conf volume step.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message