spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: Spark Streaming application failing with Token issue
Date Sun, 21 Aug 2016 15:43:48 GMT
Hi Kamesh,

I believe your only option is to re-start your application every 7
days (perhaps you need to enable checkpointing). See
https://github.com/apache/spark/commit/ab648c0004cfb20d53554ab333dd2d198cb94ffa
for a change with automatic security token renewal.


Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski


On Thu, Aug 18, 2016 at 11:51 AM, Kamesh <kam.iitkgp@gmail.com> wrote:
> Hi all,
>
>  I am running a spark streaming application that store events into
> Secure(Kerborized) HBase cluster. I launched this spark streaming
> application by passing --principal and --keytab. Despite this, spark
> streaming application is failing after 7days with Token issue. Can someone
> please suggest how to fix this.
>
> Error Message
>
> 16/08/18 02:39:45 WARN ipc.AbstractRpcClient: Exception encountered while
> connecting to the server :
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken):
> Token has expired
>
> 16/08/18 02:39:45 WARN security.UserGroupInformation:
> PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS)
> cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken):
> Token has expired
>
> Environment
>
> Spark Version : 1.6.1
>
> HBase version : 1.0.0
>
> Hadoop Version : 2.6.0
>
>
> Thanks & Regards
> Kamesh.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message