spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Rosen (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (SPARK-12895) Implement TaskMetrics using accumulators
Date Wed, 27 Jan 2016 19:16:39 GMT

     [ https://issues.apache.org/jira/browse/SPARK-12895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Josh Rosen resolved SPARK-12895.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 2.0.0

Issue resolved by pull request 10835
[https://github.com/apache/spark/pull/10835]

> Implement TaskMetrics using accumulators
> ----------------------------------------
>
>                 Key: SPARK-12895
>                 URL: https://issues.apache.org/jira/browse/SPARK-12895
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Spark Core
>            Reporter: Andrew Or
>            Assignee: Andrew Or
>             Fix For: 2.0.0
>
>
> We need to first do this before we can avoid sending TaskMetrics from the executors to
the driver. After we do this, we can send only accumulator updates instead of both that AND
TaskMetrics.
> By the end of this issue TaskMetrics will be a wrapper of accumulators. It will be only
syntactic sugar for setting these accumulators.
> But first, we need to express everything in TaskMetrics as accumulators.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message