spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shixiong(Ryan) Zhu" <shixi...@databricks.com>
Subject Re: Handle Null Columns in Spark Structured Streaming Kafka
Date Mon, 29 Apr 2019 22:56:38 GMT
Hey Snehasish,

Do you have a reproducer for this issue?

Best Regards,
Ryan


On Wed, Apr 24, 2019 at 7:24 AM SNEHASISH DUTTA <info.snehasish@gmail.com>
wrote:

> Hi,
>
> While writing to kafka using spark structured streaming , if all the
> values in certain column are Null it gets dropped
> Is there any way to override this , other than using na.fill functions
>
> Regards,
> Snehasish
>

Mime
View raw message