On 21 Aug 2016, at 20:43, Mich Talebzadeh <mich.talebzadeh@gmail.com> wrote:

Hi Kamesh,

The message you are getting after 7 days:

PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS) cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken): Token has expired

Sounds like an IPC issue with Kerberos Authentication time out. Suggest you talk to your Linux admin and also check this link:

https://support.f5.com/kb/en-us/products/big-ip_apm/manuals/product/apm-authentication-single-sign-on-11-5-0/9.print.html




7 days is one of the big kerberos timeout events; why its best to deploy a new system on a tuesday morning.

You are going to need to configure your spark app with a keytab in spark.yarn.keytab; see http://spark.apache.org/docs/latest/running-on-yarn.html