tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajesh Balamohan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3808) ShuffleHandler: optimize fadvise calls for broadcast edge
Date Mon, 31 Jul 2017 04:34:00 GMT
Rajesh Balamohan created TEZ-3808:
-------------------------------------

             Summary: ShuffleHandler: optimize fadvise calls for broadcast edge
                 Key: TEZ-3808
                 URL: https://issues.apache.org/jira/browse/TEZ-3808
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Rajesh Balamohan
            Priority: Minor


Currently, once the data is transferred `fadvise` call is invoked to throw away the pages.
This may not be very helpful in broadcast, as it would tend to transfer the same data to multiple
downstream tasks.

Similar hive ticket: HIVE-17174



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message