spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bram <theodorus.abra...@gmail.com>
Subject [Structured Streaming] Deserializing avro messages from kafka source using schema registry
Date Fri, 09 Feb 2018 23:07:29 GMT
Hi,

I couldn't find any documentation about avro message deserialization using
pyspark structured streaming. My aim is using confluent schema registry to
get per topic schema then parse the avro messages with it.

I found one but it was using DirectStream approach
https://stackoverflow.com/questions/30339636/spark-python-avro-kafka-deserialiser

Can anyone show me how?

Thanks

Regards,

Abraham

Mime
View raw message