hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaomin Zhang (Jira)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-7306) Mistaken cyclic check in JobControl Job DAG
Date Tue, 17 Nov 2020 07:49:00 GMT
Xiaomin Zhang created MAPREDUCE-7306:

             Summary: Mistaken cyclic check in JobControl Job DAG
                 Key: MAPREDUCE-7306
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7306
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: client, mrv2
    Affects Versions: 3.0.0
            Reporter: Xiaomin Zhang

MAPREDUCE-4371 added cyclic dependency check for a topologic sorted Job DAG. However it is
somehow not properly implemented for the `sort` phase.

In the while loop as below:

// code placeholder
visit the parent node followed by the child node. If the given graph contains a cycle, then
there is at least one node which is a parent as well as a child so this will break Topological
Order. Therefore, after the topological sort, check for every directed edge whether it follows
the order or not.




This message was sent by Atlassian Jira

To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org

View raw message