I am trying to read kafka and save the data as parquet file on hdfs according to this https://stackoverflow.co
m/questions/45827664/read-from -kafka-and-write-to-hdfs-in- parquetThe code is similar to :while I am writing in Java.
val df = spark .read .format("kafka") .option("kafka.bootstrap.serve
rs", "host1:port1,host2:port2") .option("subscribe", "topic1") .load()However, I keep throwing the following warning:CachedKafkaConsumer: CachedKafkaConsumer is not running in UninterruptibleThread. It may hang when CachedKafkaConsumer's method are interrupted because of KAFKA-1894.How to solve it? Thanks!Regard,