spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-16861) Refactor PySpark accumulator API to be on top of AccumulatorV2 API
Date Fri, 23 Sep 2016 08:45:21 GMT

     [ https://issues.apache.org/jira/browse/SPARK-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sean Owen updated SPARK-16861:
------------------------------
    Assignee: holdenk
    Priority: Minor  (was: Major)

> Refactor PySpark accumulator API to be on top of AccumulatorV2 API
> ------------------------------------------------------------------
>
>                 Key: SPARK-16861
>                 URL: https://issues.apache.org/jira/browse/SPARK-16861
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark, Spark Core
>            Reporter: holdenk
>            Assignee: holdenk
>            Priority: Minor
>             Fix For: 2.1.0
>
>
> The PySpark accumulator API is implemented on top of the legacy accumulator API which
is now deprecated. To allow this deprecated API to be removed eventually we will need to rewrite
the PySpark accumulators on top of the new API. An open question for a possible follow up
is if we want to make the Python accumulator API look more like the new accumulator API.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message