spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Loughran <ste...@hortonworks.com>
Subject Re: Spark Streaming application failing with Token issue
Date Tue, 23 Aug 2016 09:51:45 GMT

On 21 Aug 2016, at 20:43, Mich Talebzadeh <mich.talebzadeh@gmail.com<mailto:mich.talebzadeh@gmail.com>>
wrote:

Hi Kamesh,

The message you are getting after 7 days:

PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken):
Token has expired

Sounds like an IPC issue with Kerberos Authentication time out. Suggest you talk to your Linux
admin and also check this link:

https://support.f5.com/kb/en-us/products/big-ip_apm/manuals/product/apm-authentication-single-sign-on-11-5-0/9.print.html




7 days is one of the big kerberos timeout events; why its best to deploy a new system on a
tuesday morning.

You are going to need to configure your spark app with a keytab in spark.yarn.keytab; see
http://spark.apache.org/docs/latest/running-on-yarn.html

Mime
View raw message