spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Shtelma <mshte...@gmail.com>
Subject Re: Read Avro Data using Spark Streaming
Date Wed, 14 Nov 2018 10:19:30 GMT
Hi,

you can use this project in order to read Avro using Spark Structured
Streaming:
https://github.com/AbsaOSS/ABRiS

Spark 2.4 has also built in support for Avro, so you can use from_avro
function in Spark 2.4.

Best,
Michael


On Sat, Nov 3, 2018 at 4:34 AM Divya Narayan <narayan.divya17@gmail.com>
wrote:

> Hi,
>
> I produced avro data to kafka topic using schema registry and now I want
> to use spark streaming to read that data and do some computation in real
> time. Can some one please give a sample code for doing that . I couldn't
> find any working code online. I am using spark version 2.2.0 and
> spark-streaming-kafka-0-10_2.11.
>
> Thanks
> Divya
>

Mime
View raw message