spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kuttaiah Robin <>
Subject Spark Listeners for getting dataset partition information in streaming application
Date Fri, 02 Nov 2018 08:59:06 GMT

Is there a way spark streaming application will get to know during the
start and end of the data read from a dataset partition?
I want to create partition specific cache during the start and delete
during the partition is read completely.

Thanks for you help in advance.

Robin Kuttaiah

View raw message