spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-19565) After fetching failed, success of old attempt of stage should be taken as valid.
Date Sun, 12 Feb 2017 13:36:42 GMT

     [ https://issues.apache.org/jira/browse/SPARK-19565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-19565:
------------------------------------

    Assignee: Apache Spark

> After fetching failed, success of old attempt of stage should be taken as valid.
> --------------------------------------------------------------------------------
>
>                 Key: SPARK-19565
>                 URL: https://issues.apache.org/jira/browse/SPARK-19565
>             Project: Spark
>          Issue Type: Test
>          Components: Scheduler
>    Affects Versions: 2.1.0
>            Reporter: jin xing
>            Assignee: Apache Spark
>
> This is related to SPARK-19263. 
> When fetch failed, stage will be resubmitted. There can be running tasks from both old
and new stage attempts. Success of tasks from old stage attempt should be taken as valid and
partitionId should be removed from stage's pendingPartitions accordingly. When pending partitions
is empty, downstream stage can be scheduled, even though there's still running tasks in the
active(new) stage attempt.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message