spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sachit Murarka <connectsac...@gmail.com>
Subject Error while running Spark on K8s
Date Mon, 04 Jan 2021 11:55:21 GMT
Hi All,
I am getting the below error when I am trying to run the spark job on
Kubernetes, I am running it in cluster mode.

Exception in thread "main"
io.fabric8.kubernetes.client.KubernetesClientException: Operation:
[create] for kind: [Pod] with name: [null] in namespace:
[spark-test] failed.
at
io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:64)
at
io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:72)


I saw there was an JIRA opened already. SPARK-31786
I tried the parameter mentioned in JIRA
too(spark.kubernetes.driverEnv.HTTP2_DISABLE=true), that also did not work.
Can anyone suggest what can be done?

Kind Regards,
Sachit Murarka

Mime
View raw message