spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Raajay <>
Subject Visualize Spark-SQL query plans
Date Thu, 25 Jun 2015 16:33:35 GMT

I am trying to understand the code base of spark-SQL, especially the Query
Analyzer part. I understand that currently (as of Spark 1.4), the sql
module generates a set of Physical plans, but executes only the first in
the list (ref : core/src/main/scala/org/apache/spark/sql/SQLContext.scala,
lines ~930).

I wish to visualize all the query plans generated and possibly execute them
all as different jobs. How should I proceed in order to accomplish this?


View raw message