spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Holden Karau <hol...@pigscanfly.ca>
Subject Data Property Accumulators
Date Sat, 17 Aug 2019 00:48:27 GMT
Are folks interested in seeing data property accumulators for RDDs? I made
a proposal for this back in Spark 2016 (
https://docs.google.com/document/d/1lR_l1g3zMVctZXrcVjFusq2iQVpr4XvRK_UUDsDr6nk/edit
) but
ABI compatibility was a stumbling block I couldn't design around. I can
look at reviving it for Spark 3 or just go ahead and close out this idea.

-- 
Twitter: https://twitter.com/holdenkarau
Books (Learning Spark, High Performance Spark, etc.):
https://amzn.to/2MaRAG9  <https://amzn.to/2MaRAG9>
YouTube Live Streams: https://www.youtube.com/user/holdenkarau

Mime
View raw message