tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kuhu Shukla (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3607) ShuffleScheduler#allEventsReceived check is too tight
Date Fri, 03 Feb 2017 21:18:51 GMT
Kuhu Shukla created TEZ-3607:
--------------------------------

             Summary: ShuffleScheduler#allEventsReceived check is too tight
                 Key: TEZ-3607
                 URL: https://issues.apache.org/jira/browse/TEZ-3607
             Project: Apache Tez
          Issue Type: Sub-task
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


In case of skipped records being non zero, the allEventsReceived() call can return false even
when all the events have in fact been received since pathtoAttemptsMap size plus the skipped
counter may be more than the total number of inputs since we don't take out entries from the
map if skipped counter is incremented.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message