spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wojciech PituĊ‚a <>
Subject Numer of "runJob at SparkPlan.scala:122" in Spark SQL
Date Fri, 10 Jul 2015 05:14:19 GMT

I was wondering if it is possible to tune number of jobs generated by spark
sql? Currently my query generates over 80 "runJob at SparkPlan.scala:122"
jobs, every one of them gets executed in ~4 sec and contains only 5 tasks.
As a result of this, most of my cores do nothing.

View raw message