hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xiaomin Zhang (Jira)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-7306) Mistaken cyclic check in JobControl Job DAG
Date Tue, 17 Nov 2020 07:49:00 GMT
Xiaomin Zhang created MAPREDUCE-7306:
----------------------------------------

             Summary: Mistaken cyclic check in JobControl Job DAG
                 Key: MAPREDUCE-7306
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7306
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: client, mrv2
    Affects Versions: 3.0.0
            Reporter: Xiaomin Zhang


MAPREDUCE-4371 added cyclic dependency check for a topologic sorted Job DAG. However it is
somehow not properly implemented for the `sort` phase.

In the while loop as below:

 
{code:java}
// code placeholder
{code}
visit the parent node followed by the child node. If the given graph contains a cycle, then
there is at least one node which is a parent as well as a child so this will break Topological
Order. Therefore, after the topological sort, check for every directed edge whether it follows
the order or not.

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org


Mime
View raw message