tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kuhu Shukla (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-4019) Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead of LocalDirAllocator
Date Tue, 13 Nov 2018 22:01:06 GMT
Kuhu Shukla created TEZ-4019:
--------------------------------

             Summary: Modify Tez shuffle handler to use AuxiliaryLocalPathHandler instead
of LocalDirAllocator
                 Key: TEZ-4019
                 URL: https://issues.apache.org/jira/browse/TEZ-4019
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


Like with the MR shuffle handler , this new API (YARN-7244) exposed in Hadoop version 2.8.2
and up helps keep the NM's view of disks good to use and the auxiliary services' view in sync.
Tez right now compiles with 2.7 but when we move that we should allow this new good behavior
to come in.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message