spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Grandl Robert <>
Subject question regarding the dependency DAG in Spark
Date Mon, 16 Mar 2015 20:58:38 GMT
Hi guys,

I am trying to get a better understanding of the DAG generation for a job in Spark. 

Ideally, what I want is to run some SQL query and extract the generated DAG by Spark. By DAG
I mean the stages and dependencies among stages, and the number of tasks in every stage.

Could you guys point me to the code where is that happening ?

Thank you,

View raw message