tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adrian Nicoara <adn...@microsoft.com.INVALID>
Subject VertexGroup and ONE_TO_ONE edge
Date Mon, 13 Aug 2018 20:18:11 GMT
Hello,

Consider the following test:
https://github.com/apache/tez/blob/90c8195de0ddee9da3d4cd07519c8e287c85ad50/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831

For the VertexGroup uv23, we have a total of 4 tasks, 2 coming from v2, and 2 coming from
v3.
This is connected to v5, which in the test, we assert has a total of 2 tasks, after DAG.verify
runs (which infers parallelism for one to one edges).
However, isn't the expected number of tasks in v5 supposed to be 4, as uv23 acts as a union?

Thanks,
Adrian

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message