spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiao Li (Jira)" <j...@apache.org>
Subject [jira] [Reopened] (SPARK-3115) Improve task broadcast latency for small tasks
Date Wed, 28 Aug 2019 18:14:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Xiao Li reopened SPARK-3115:
----------------------------

> Improve task broadcast latency for small tasks
> ----------------------------------------------
>
>                 Key: SPARK-3115
>                 URL: https://issues.apache.org/jira/browse/SPARK-3115
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 1.1.0
>            Reporter: Shivaram Venkataraman
>            Assignee: Reynold Xin
>            Priority: Major
>
> Broadcasting the task information helps reduce the amount of data transferred for large
tasks. However we've seen that this adds more latency for small tasks. It'll be great to profile
and fix this.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message