spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From HARSH TAKKAR <takkarha...@gmail.com>
Subject Structured Streaming using Kafka Avro Record in 2.3.0
Date Tue, 28 Apr 2020 11:46:39 GMT
Hi

How can we deserialise avro record read from kafka in spark 2.3.0 in
optimised manner. I could see that native support for avro was added in
2.4.x.

Currently i am using following library which is very slow.

<dependency>
    <groupId>com.twitter</groupId>
    <artifactId>bijection-avro_2.11</artifactId>
</dependency>


Kind Regards
Harsh Takkar

Mime
View raw message