TGT is not enough, you need HDFS token which can be obtained by Spark. Please check the logs...

On Fri, 8 Jan 2021, 18:51 Sudhir Babu Pothineni, <> wrote:
I spin up a spark standalone cluster (spark.autheticate=false), submitted a job which reads remote kerberized HDFS, 

val spark = SparkSession.builder()

UserGroupInformation.loginUserFromKeytab(principal, keytab)
val df ="hdfs://namenode:8020/test/parquet/")

Ran into following exception:

Caused by: Failed on local exception: Client cannot authenticate via:[TOKEN, KERBEROS]; Host Details : local host is: "..."; destination host is: "...":10346; 

Any suggestions?