spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <mich.talebza...@gmail.com>
Subject Re: Spark Streaming application failing with Token issue
Date Sun, 21 Aug 2016 19:43:53 GMT
Hi Kamesh,

The message you are getting after 7 days:

PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS)
cause:org.apache.hadoop.ipc.RemoteException(org.apache.
hadoop.security.token.SecretManager$InvalidToken): Token has expired

Sounds like an IPC issue with Kerberos Authentication time out. Suggest you
talk to your Linux admin and also check this link:

https://support.f5.com/kb/en-us/products/big-ip_apm/manuals/product/apm-authentication-single-sign-on-11-5-0/9.print.html


HTH

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.



On 21 August 2016 at 16:43, Jacek Laskowski <jacek@japila.pl> wrote:

> Hi Kamesh,
>
> I believe your only option is to re-start your application every 7
> days (perhaps you need to enable checkpointing). See
> https://github.com/apache/spark/commit/ab648c0004cfb20d53554ab333dd2d
> 198cb94ffa
> for a change with automatic security token renewal.
>
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://medium.com/@jaceklaskowski/
> Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark
> Follow me at https://twitter.com/jaceklaskowski
>
>
> On Thu, Aug 18, 2016 at 11:51 AM, Kamesh <kam.iitkgp@gmail.com> wrote:
> > Hi all,
> >
> >  I am running a spark streaming application that store events into
> > Secure(Kerborized) HBase cluster. I launched this spark streaming
> > application by passing --principal and --keytab. Despite this, spark
> > streaming application is failing after 7days with Token issue. Can
> someone
> > please suggest how to fix this.
> >
> > Error Message
> >
> > 16/08/18 02:39:45 WARN ipc.AbstractRpcClient: Exception encountered while
> > connecting to the server :
> > org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.
> SecretManager$InvalidToken):
> > Token has expired
> >
> > 16/08/18 02:39:45 WARN security.UserGroupInformation:
> > PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS)
> > cause:org.apache.hadoop.ipc.RemoteException(org.apache.
> hadoop.security.token.SecretManager$InvalidToken):
> > Token has expired
> >
> > Environment
> >
> > Spark Version : 1.6.1
> >
> > HBase version : 1.0.0
> >
> > Hadoop Version : 2.6.0
> >
> >
> > Thanks & Regards
> > Kamesh.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>

Mime
View raw message