spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: Spark Streaming application failing with Token issue
Date Tue, 23 Aug 2016 10:26:23 GMT
Hi Steve,

Could you share your opinion on whether the token gets renewed or not?
Is the token going to expire after 7 days anyway? Why is the change in
the recent version for token renewal? See
https://github.com/apache/spark/commit/ab648c0004cfb20d53554ab333dd2d198cb94ffa

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski


On Tue, Aug 23, 2016 at 11:51 AM, Steve Loughran <stevel@hortonworks.com> wrote:
>
> On 21 Aug 2016, at 20:43, Mich Talebzadeh <mich.talebzadeh@gmail.com> wrote:
>
> Hi Kamesh,
>
> The message you are getting after 7 days:
>
> PriviledgedActionException as:sys_bio_replicator (auth:KERBEROS)
> cause:org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.token.SecretManager$InvalidToken):
> Token has expired
>
> Sounds like an IPC issue with Kerberos Authentication time out. Suggest you
> talk to your Linux admin and also check this link:
>
> https://support.f5.com/kb/en-us/products/big-ip_apm/manuals/product/apm-authentication-single-sign-on-11-5-0/9.print.html
>
>
>
>
> 7 days is one of the big kerberos timeout events; why its best to deploy a
> new system on a tuesday morning.
>
> You are going to need to configure your spark app with a keytab in
> spark.yarn.keytab; see
> http://spark.apache.org/docs/latest/running-on-yarn.html

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message