spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andy Grove (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-29640) [K8S] Make it possible to set DNS option to use TCP instead of UDP
Date Tue, 29 Oct 2019 18:35:00 GMT
Andy Grove created SPARK-29640:
----------------------------------

             Summary: [K8S] Make it possible to set DNS option to use TCP instead of UDP
                 Key: SPARK-29640
                 URL: https://issues.apache.org/jira/browse/SPARK-29640
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 2.4.4
            Reporter: Andy Grove
             Fix For: 2.4.5


We are running into intermittent DNS issues where the Spark driver fails to resolve "kubernetes.default.svc"
and this seems to be caused by [https://github.com/kubernetes/kubernetes/issues/76790]

One suggested workaround is to specify TCP mode for DNS lookups in the pod spec ([https://github.com/kubernetes/kubernetes/issues/56903#issuecomment-424498508]).

I would like the ability to provide a flag to spark-submit to specify to use TCP mode for
DNS lookups.

I am working on a PR for this.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message