spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matt Cheah <mch...@palantir.com>
Subject [PSA] Sharing our Experiences With Kubernetes
Date Fri, 17 May 2019 19:22:04 GMT
Hi everyone,

 

I would like to share the experiences my organization has had with deploying Kubernetes and
migrating our Spark applications to Kubernetes over from YARN. We are publishing a series
of blog posts that describe what we have learned and what we have built.

 

Our introduction post is here: https://medium.com/palantir/introducing-rubix-kubernetes-at-palantir-ab0ce16ea42e

 

We then discuss our custom scheduling work here: https://medium.com/palantir/spark-scheduling-in-kubernetes-4976333235f3

 

Stay tuned for more posts in this space! I hope that this is helpful for you.

 

-Matt Cheah


Mime
View raw message