spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Cody Koeninger (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-18033) Deprecate TaskContext.partitionId
Date Thu, 20 Oct 2016 18:44:58 GMT
Cody Koeninger created SPARK-18033:
--------------------------------------

             Summary: Deprecate TaskContext.partitionId
                 Key: SPARK-18033
                 URL: https://issues.apache.org/jira/browse/SPARK-18033
             Project: Spark
          Issue Type: Improvement
            Reporter: Cody Koeninger


Mark TaskContext.partitionId as deprecated, because it doesn't always reflect the physical
index at the time the RDD is created.  Add a foreachPartitionWithIndex method to mirror the
existing mapPartitionsWithIndex method.

For background, see

http://apache-spark-developers-list.1001551.n3.nabble.com/PSA-TaskContext-partitionId-the-actual-logical-partition-index-td19524.html





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message