there any guidelines or specs to write a Spark package? I would like to
implement a spark package and would like to know the way it needs to be
structured (implement some interfaces etc) so that it can plug into Spark
for extended functionality.
any one help me point to docs or links on the above?