spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mania Abdi <>
Subject Spark DAG scheduler
Date Thu, 16 Apr 2020 22:16:23 GMT
Hello everyone,

I am implementing a caching mechanism for analytic workloads running on top
of Spark and I need to retrieve the Spark DAG right after it is generated
and the DAG scheduler. I would appreciate it if you could give me some
hints or reference me to some documents about where the DAG is generated
and inputs assigned to it. I found the DAG Scheduler class
but I am not sure if it is a good starting point.


View raw message