tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Muhammad Samir Khan (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3772) Allow slowstart for small jobs to be treated differently
Date Thu, 22 Jun 2017 21:17:00 GMT
Muhammad Samir Khan created TEZ-3772:
----------------------------------------

             Summary: Allow slowstart for small jobs to be treated differently
                 Key: TEZ-3772
                 URL: https://issues.apache.org/jira/browse/TEZ-3772
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Muhammad Samir Khan
            Assignee: Muhammad Samir Khan


If there are a small number of reduces (configurable), then having a different threshold can
benefit. Performance of jobs with a small number of reduce tasks can benefit significantly.
Yes, the job could specify slowstart as 0.0 instead of the default, but that requires job
owners to do something. It would be better if the defaults did something more optimal for
both large and small jobs.




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message