spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 吴晓菊 <chrysan...@gmail.com>
Subject Can we let tasks of broadcast job not wait for locality?
Date Wed, 27 Jun 2018 08:33:35 GMT
Hi All,

I noticed the task scheduling will have a locality wait (default is 3s),
which causes some tasks launched after a long delay(sometimes more than
3s), especially there are lots of tasks requesting to run concurrently and
waiting for resources.

Why not let tasks of broadcast job not to wait for locality since it always
has very small volume of data?

Chrysan Wu
Phone:+86 17717640807

Mime
View raw message