tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jonathan Eagles (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (TEZ-746) DAG and Vertex commit should ensure that all tasks have completed before committing
Date Tue, 07 May 2019 20:05:00 GMT

     [ https://issues.apache.org/jira/browse/TEZ-746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jonathan Eagles resolved TEZ-746.
---------------------------------
    Resolution: Duplicate

> DAG and Vertex commit should ensure that all tasks have completed before committing
> -----------------------------------------------------------------------------------
>
>                 Key: TEZ-746
>                 URL: https://issues.apache.org/jira/browse/TEZ-746
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Bikas Saha
>            Assignee: Bikas Saha
>            Priority: Major
>
> There may be a race when a task (say a speculative task) is still running. Then the committer
commits (say lists & cleans some files in the output dir). Then that task writes some
temporary files in the output dir and gets killed. Those temp files may remain behind.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message