spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Segel <>
Subject Re: Spark Streaming backpressure weird behavior/bug
Date Mon, 07 Nov 2016 17:34:48 GMT

Spark inherits its security from the underlying mechanisms in either YARN or MESOS (whichever
environment you are launching your cluster/jobs)

That said… there is limited support from Ranger.  There are three parts to this…

1) Ranger being called when the job is launched…

2) Ranger being called when data is being read from disk (HDFS) or HBase, however… once
the application has the data… its fair game.

Now if Ranger were woven in to a thrift server (which would be a one off ) then you would
have more security if you were planning on providing the data to multiple users and applications…

Does that help?

On Nov 7, 2016, at 3:41 AM, Mudit Kumar <<>>


Do ranger provide security to spark?If yes,then in what capacity.


View raw message