spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "aka.fe2s" <>
Subject static dataframe to streaming
Date Tue, 05 Nov 2019 20:23:54 GMT
Hi All,

What is the most efficient way of converting static dataframe to streaming
(structured streaming)?
I have a custom sink implemented for structured streaming and I would like
to use it to write a static dataframe.
I know that I can write a dataframe to files and then source them to a
create a stream. Is there any more efficient way to do this?


View raw message