spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From emiretsk <eugene.miret...@gmail.com>
Subject How are threads created in SQL Executor?
Date Fri, 01 Jul 2016 15:42:32 GMT
It seems like threads are created by SQLExecution.withExecutionId, which is
called inside BroadcastExchangeExec.scala. 
When does the plan executor execute a BroadcaseExchange, and is there a way
to control the number of threads? We have a job that writes DataFrames to an
external DB, and it seems like each task creates as many threads as there
are cores. 






--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-are-threads-created-in-SQL-Executor-tp27260.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message