spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gerard Casey <gerardhughca...@gmail.com>
Subject Re: Kerberos and YARN - functions in spark-shell and spark submit local but not cluster mode
Date Thu, 08 Dec 2016 19:17:11 GMT
Right. I’m confident that is setup correctly.

I can run the SparkPi test script. The main difference between it and my application is that
it doesn’t access HDFS. 

> On 8 Dec 2016, at 18:43, Marcelo Vanzin <vanzin@cloudera.com> wrote:
> 
> On Wed, Dec 7, 2016 at 11:54 PM, Gerard Casey <gerardhughcasey@gmail.com> wrote:
>> To be specific, where exactly should spark.authenticate be set to true?
> 
> spark.authenticate has nothing to do with kerberos. It's for
> authentication between different Spark processes belonging to the same
> app.
> 
> -- 
> Marcelo
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
> 


---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message