spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ramaswamy, Muthuraman" <Muthuraman.Ramasw...@viasat.com>
Subject PySpark Streaming : Accessing the Remote Secured Kafka
Date Wed, 10 Oct 2018 01:31:12 GMT
All,

Currently, I am using PySpark Streaming (Classic Regular DStream Style and not Structured
Streaming). Now, our remote Kafka is secured with Kerberos.

To enable PySpark Streaming to access the secured Kafka, what steps I should perform? Can
I pass the principal/keytab and jaas config in the Spark Submit command? What are my options?
Any pointers/links to access the secured Kafka broker from PySpark Streaming will be helpful.

Appreciate your time.

Thank you,

~Muthu


Mime
View raw message