Hi everyone!

I just published this blog post on how Spark Scala custom transformations can be re-arranged to better be composed and used within .transform:

 https://medium.com/@dmateusp/dataframe-transform-spark-function-composition-eb8ec296c108

I found the discussions in this group to be largely around issues / performance, this post only concerns itself with code readability, hopefully not off-topic!

I welcome any feedback I can get :)

Daniel