spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Somogyi (Jira)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-31679) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create new KafkaAdminClient
Date Tue, 12 May 2020 08:44:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-31679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17105237#comment-17105237
] 

Gabor Somogyi commented on SPARK-31679:
---------------------------------------

As I see there are no artifacts for previous jenkins executions which blocks further investigation.
Without logs can't really tell what has happened with KDC.

[~srowen] [~dongjoon] is it possible to reach previous jenkins execution artifacts somehow?


> Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite: Failed to create
new KafkaAdminClient
> ----------------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-31679
>                 URL: https://issues.apache.org/jira/browse/SPARK-31679
>             Project: Spark
>          Issue Type: Bug
>          Components: Structured Streaming, Tests
>    Affects Versions: 3.0.0
>            Reporter: Gabor Somogyi
>            Priority: Major
>
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/122389/testReport/
> {code:java}
> Failed
> org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite.(It is not a test it is a sbt.testing.SuiteSelector)
> Failing for the past 1 build (Since Failed#122389 )
> Took 34 sec.
> Error Message
> org.apache.kafka.common.KafkaException: Failed to create new KafkaAdminClient
> Stacktrace
> sbt.ForkMain$ForkError: org.apache.kafka.common.KafkaException: Failed to create new
KafkaAdminClient
> 	at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:479)
> 	at org.apache.kafka.clients.admin.Admin.create(Admin.java:61)
> 	at org.apache.kafka.clients.admin.AdminClient.create(AdminClient.java:39)
> 	at org.apache.spark.sql.kafka010.KafkaTestUtils.setupEmbeddedKafkaServer(KafkaTestUtils.scala:267)
> 	at org.apache.spark.sql.kafka010.KafkaTestUtils.setup(KafkaTestUtils.scala:290)
> 	at org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite.beforeAll(KafkaDelegationTokenSuite.scala:49)
> 	at org.scalatest.BeforeAndAfterAll.liftedTree1$1(BeforeAndAfterAll.scala:212)
> 	at org.scalatest.BeforeAndAfterAll.run(BeforeAndAfterAll.scala:210)
> 	at org.scalatest.BeforeAndAfterAll.run$(BeforeAndAfterAll.scala:208)
> 	at org.apache.spark.SparkFunSuite.run(SparkFunSuite.scala:58)
> 	at org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:317)
> 	at org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:510)
> 	at sbt.ForkMain$Run$2.call(ForkMain.java:296)
> 	at sbt.ForkMain$Run$2.call(ForkMain.java:286)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 	at java.lang.Thread.run(Thread.java:748)
> Caused by: sbt.ForkMain$ForkError: org.apache.kafka.common.KafkaException: javax.security.auth.login.LoginException:
Client not found in Kerberos database (6) - Client not found in Kerberos database
> 	at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:172)
> 	at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:157)
> 	at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:73)
> 	at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:105)
> 	at org.apache.kafka.clients.admin.KafkaAdminClient.createInternal(KafkaAdminClient.java:454)
> 	... 17 more
> Caused by: sbt.ForkMain$ForkError: javax.security.auth.login.LoginException: Client not
found in Kerberos database (6) - Client not found in Kerberos database
> 	at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:804)
> 	at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:617)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:498)
> 	at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755)
> 	at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195)
> 	at javax.security.auth.login.LoginContext$4.run(LoginContext.java:682)
> 	at javax.security.auth.login.LoginContext$4.run(LoginContext.java:680)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
> 	at javax.security.auth.login.LoginContext.login(LoginContext.java:587)
> 	at org.apache.kafka.common.security.authenticator.AbstractLogin.login(AbstractLogin.java:60)
> 	at org.apache.kafka.common.security.kerberos.KerberosLogin.login(KerberosLogin.java:103)
> 	at org.apache.kafka.common.security.authenticator.LoginManager.<init>(LoginManager.java:62)
> 	at org.apache.kafka.common.security.authenticator.LoginManager.acquireLoginManager(LoginManager.java:105)
> 	at org.apache.kafka.common.network.SaslChannelBuilder.configure(SaslChannelBuilder.java:158)
> 	... 21 more
> Caused by: sbt.ForkMain$ForkError: sun.security.krb5.KrbException: Client not found in
Kerberos database (6) - Client not found in Kerberos database
> 	at sun.security.krb5.KrbAsRep.<init>(KrbAsRep.java:82)
> 	at sun.security.krb5.KrbAsReqBuilder.send(KrbAsReqBuilder.java:316)
> 	at sun.security.krb5.KrbAsReqBuilder.action(KrbAsReqBuilder.java:361)
> 	at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:776)
> 	... 38 more
> Caused by: sbt.ForkMain$ForkError: sun.security.krb5.Asn1Exception: Identifier doesn't
match expected value (906)
> 	at sun.security.krb5.internal.KDCRep.init(KDCRep.java:140)
> 	at sun.security.krb5.internal.ASRep.init(ASRep.java:64)
> 	at sun.security.krb5.internal.ASRep.<init>(ASRep.java:59)
> 	at sun.security.krb5.KrbAsRep.<init>(KrbAsRep.java:60)
> 	... 41 more
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message