Hi guys,

I am trying to get a better understanding of the DAG generation for a job in Spark.

Ideally, what I want is to run some SQL query and extract the generated DAG by Spark. By DAG I mean the stages and dependencies among stages, and the number of tasks in every stage.

Could you guys point me to the code where is that happening ?

Thank you,