tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kuhu Shukla (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case
Date Thu, 11 May 2017 20:25:04 GMT
Kuhu Shukla created TEZ-3723:
--------------------------------

             Summary: TezIndexRecord#hasData() returns true for empty index record in the
Unordered case
                 Key: TEZ-3723
                 URL: https://issues.apache.org/jira/browse/TEZ-3723
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


In the case of Unordered writer, use of {{hasData()}} returns true for empty partitions since
the rawlength is zero (as writer skips writing them out altogether) and the check in hasData
will fail as {{rawlength == header.length +2}} fails.

This currently works for the ordered case(and the method is used here unlike in unordered
writer) but after TEZ-3605, it will fail for both scenarios. Even if we don't use the method,
the logic should be fixed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message