spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Holden Karau <hol...@pigscanfly.ca>
Subject Initial Decom PR for Spark 3?
Date Tue, 04 Feb 2020 21:44:45 GMT
Hi Y’all,

I’ve got a K8s graceful decom PR (
https://github.com/apache/spark/pull/26440
 ) I’d love to try and get in for Spark 3, but I don’t want to push on it
if folks don’t think it’s worth it. I’ve been working on it since 2017 and
it was really close in November but then I had the crash and had to step
back for awhile.

It’s effectiveness is behind a feature flag and it’s been outstanding for
awhile so those points are in its favour. It does however change things in
core which is not great.

Cheers,

Holden
-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Mime
View raw message