tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kuhu Shukla (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-4053) TestExceptionPropagation.testExceptionPropagationSession fails intermittently
Date Wed, 13 Mar 2019 20:55:00 GMT
Kuhu Shukla created TEZ-4053:
--------------------------------

             Summary: TestExceptionPropagation.testExceptionPropagationSession fails intermittently
                 Key: TEZ-4053
                 URL: https://issues.apache.org/jira/browse/TEZ-4053
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


Irrespective of the test case failing or not I see the below stack trace that needs to be
looked at:
{code}
2019-03-13 15:12:19,457 [INFO] [Dispatcher thread {Central}] |HistoryEventHandler.criticalEvents|:
[HISTORY][DAG:dag_1552507929653_0001_1][Event:DAG_FINISHED]: dagId=dag_1552507929653_0001_1,
startTime=1552507939233, finishTime=1552507939419, timeTaken=186, status=FAILED, diagnostics=Vertex
failed, vertexName=v1, vertexId=vertex_1552507929653_0001_1_00, diagnostics=[Exception in
EdgeManager, vertex:vertex_1552507929653_0001_1_00 [v1],java.lang.RuntimeException: EM_GetNumSourceTaskPhysicalOutputs
        at org.apache.tez.test.TestExceptionPropagation$CustomEdgeManager.getNumSourceTaskPhysicalOutputs(TestExceptionPropagation.java:828)
        at org.apache.tez.dag.app.dag.impl.Edge.getSourceSpec(Edge.java:340)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getSourceSpecFor(VertexImpl.java:4489)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getOutputSpecList(VertexImpl.java:4477)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.createRemoteTaskSpec(VertexImpl.java:1647)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.scheduleTasks(VertexImpl.java:1683)
] completed., numCompletedVertices=2, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=1,
numVertices=2
2019-03-13 15:12:19,418 [INFO] [Dispatcher thread {Central}] |impl.DAGImpl|: Checking vertices
for DAG completion, num
CompletedVertices=2, numSuccessfulVertices=0, numFailedVertices=1, numKilledVertices=1, numVertices=2,
commitInProgres
s=0, terminationCause=VERTEX_FAILURE
2019-03-13 15:12:19,418 [INFO] [Dispatcher thread {Central}] |impl.DAGImpl|: DAG did not succeed
due to VERTEX_FAILURE
. failedVertices:1 killedVertices:1
2019-03-13 15:12:19,443 [INFO] [Dispatcher thread {Central}] |recovery.RecoveryService|: DAG
completed, dagId=dag_1552
507929653_0001_1, queueSize=0
2019-03-13 15:12:19,457 [INFO] [Dispatcher thread {Central}] |HistoryEventHandler.criticalEvents|:
[HISTORY][DAG:dag_1
552507929653_0001_1][Event:DAG_FINISHED]: dagId=dag_1552507929653_0001_1, startTime=1552507939233,
finishTime=15525079
39419, timeTaken=186, status=FAILED, diagnostics=Vertex failed, vertexName=v1, vertexId=vertex_1552507929653_0001_1_00
, diagnostics=[Exception in EdgeManager, vertex:vertex_1552507929653_0001_1_00 [v1],java.lang.RuntimeException:
EM_Get
NumSourceTaskPhysicalOutputs
        at org.apache.tez.test.TestExceptionPropagation$CustomEdgeManager.getNumSourceTaskPhysicalOutputs(TestExceptio
nPropagation.java:828)
        at org.apache.tez.dag.app.dag.impl.Edge.getSourceSpec(Edge.java:340)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getSourceSpecFor(VertexImpl.java:4489)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.getOutputSpecList(VertexImpl.java:4477)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.createRemoteTaskSpec(VertexImpl.java:1647)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.scheduleTasks(VertexImpl.java:1683)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerPluginContextImpl.scheduleTasks(VertexManager.java:221)
        at org.apache.tez.dag.app.dag.impl.RootInputVertexManager.schedulePendingTasks(RootInputVertexManager.java:386)
        at org.apache.tez.dag.app.dag.impl.RootInputVertexManager.processPendingTasks(RootInputVertexManager.java:379)
        at org.apache.tez.dag.app.dag.impl.RootInputVertexManager.onVertexStarted(RootInputVertexManager.java:182)
        at org.apache.tez.test.TestExceptionPropagation$RootInputVertexManagerWithException.onVertexStarted(TestExceptionPropagation.java:714)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEventOnVertexStarted.invoke(VertexManager.java:618)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:687)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent$1.run(VertexManager.java:682)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1953)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:682)
        at org.apache.tez.dag.app.dag.impl.VertexManager$VertexManagerEvent.call(VertexManager.java:671)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message