spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Erik Erlandson <eerla...@redhat.com>
Subject Kubernetes Big-Data-SIG notes, September 12
Date Wed, 12 Sep 2018 19:55:10 GMT
Spark
Pod template parameters <https://issues.apache.org/jira/browse/SPARK-24434>
is mostly done. The main remaining design discussion is around how (or
whether) to specify which container on the pod template is the driver pod.

HDFS
We had some discussions about the possibility of adding an HDFS operator,
in addition to the system of helm charts that Kimoon Kim has developed.
Yinan Li is looking into working on this.

Link to meeting minutes
https://docs.google.com/document/d/1pnF38NF6N5eM8DlK088XUW85
Vms4V2uTsGZvSp8MNIA

Mime
View raw message