spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From mukesh dewangan <mukesh...@gmail.com>
Subject Apache Spark|Redacion|secret keys|
Date Fri, 24 Sep 2021 09:50:21 GMT
Dear Spark Expert,

I have a issue with below "--conf 'spark.redaction.regex"

Issue:
I am passing some secret keys in spark-submit command. I am using below to
redact the key: --conf 'spark.redaction.regex='secret_key'

though it is working, the secret_key is visible in sparkUI during job
execution. The redaction takes place at the end. How to avoid this and make
sure the secret key is not visible at any period of job execution.

-- 
Thanks & Regards
Mukesh
+91-8342974492

Mime
View raw message