tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3777) Avoid buffer copies by passing RLE flag to TezMerger from PipelinedSorter
Date Tue, 27 Jun 2017 09:08:00 GMT
Rajesh Balamohan created TEZ-3777:
-------------------------------------

             Summary: Avoid buffer copies by passing RLE flag to TezMerger from PipelinedSorter
                 Key: TEZ-3777
                 URL: https://issues.apache.org/jira/browse/TEZ-3777
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Rajesh Balamohan


RLE information computed in pipelinedSorter can be passed on to {{TezMerger.merge}} in  {{PipelinedSorter::flush}}.
Depending on dataset, this can save lot of data copies.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message