spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kuttaiah Robin <kutta...@gmail.com>
Subject Spark Listeners for getting dataset partition information in streaming application
Date Fri, 02 Nov 2018 08:59:06 GMT
Hello,

Is there a way spark streaming application will get to know during the
start and end of the data read from a dataset partition?
I want to create partition specific cache during the start and delete
during the partition is read completely.

Thanks for you help in advance.

regards,
Robin Kuttaiah

Mime
View raw message