kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jay Kreps <jay.kr...@gmail.com>
Subject Re: Avro serialization
Date Tue, 20 Aug 2013 16:33:13 GMT
This paper has more information on what we are doing at LinkedIn:

This Avro JIRA has a schema repository implementation similar to the one
LinkedIn uses:


On Tue, Aug 20, 2013 at 7:08 AM, Mark <static.void.dev@gmail.com> wrote:

> Can someone break down how message serialization would work with Avro?
> I've read instead of adding a schema to every single event it would be wise
> to add some sort of fingerprint with each message to identify which schema
> it should used. What I'm having trouble understanding is, how do we read
> the fingerprint without a schema? Don't we need the schema to deserialize?
>  Same question goes for working with Hadoop.. how does the input format
> know which schema to use?
> Thanks

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message