spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arti Pande <pande.a...@gmail.com>
Subject Spark on Kubernetes
Date Fri, 13 Nov 2020 17:49:27 GMT
Hi,

Is it recommended to use Spark on K8S in production?

Spark operator for Kubernetes seems to be in beta state.
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator#:~:text=The%20Kubernetes%20Operator%20for%20Apache%20Spark%20aims%20to%20make%20specifying,surfacing%20status%20of%20Spark%20applications
.

Apparently there are open JIRA issues for spark that talk about problems on
K8s with dynamic allocation etc. Are there any workarounds? Are there any
other issues? What is the official recommendation?

Thanks & regards,
Arti Pande

Mime
View raw message