spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koert Kuipers <>
Subject Re: Does anyone implement org.apache.spark.serializer.Serializer in their own code?
Date Tue, 08 Mar 2016 03:22:42 GMT
we are not, but it seems reasonable to me that a user has the ability to
implement their own serializer.

can you refactor and break compatibility, but not make it private?

On Mon, Mar 7, 2016 at 9:57 PM, Josh Rosen <> wrote:

> Does anyone implement Spark's serializer interface
> (org.apache.spark.serializer.Serializer) in your own third-party code? If
> so, please let me know because I'd like to change this interface from a
> DeveloperAPI to private[spark] in Spark 2.0 in order to do some cleanup and
> refactoring. I think that the only reason it was a DeveloperAPI was Shark,
> but I'd like to confirm this by asking the community.
> Thanks,
> Josh

View raw message