spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Dawes <>
Subject Extract value from streaming Dataframe to a variable
Date Fri, 17 Jan 2020 23:27:22 GMT
I need to extract a value from a PySpark structured streaming Dataframe to
a string variable to check something.

I tried this code.

agentName ="agentName")).collect()[0][0]

This works on a non-streaming Dataframe only. In a streaming Dataframe,
collect is not supported.

Any workaround for this?


View raw message