hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Navis (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11518) Provide interface to adjust required resource for tez tasks
Date Fri, 21 Aug 2015 12:42:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706695#comment-14706695
] 

Navis commented on HIVE-11518:
------------------------------

[~hagleitn] Any interest on this? I could have assigned 4G for 20+ join map tasks by just
assigning 1G for other simple tasks.

> Provide interface to adjust required resource for tez tasks
> -----------------------------------------------------------
>
>                 Key: HIVE-11518
>                 URL: https://issues.apache.org/jira/browse/HIVE-11518
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>         Attachments: HIVE-11518.1.patch.txt
>
>
> Resource requirements for each tasks are varied but currently it's fixed to one value(via
hive.tez.container.size). It would be good to customize resource requirements appropriate
to expected work.
> Suggested interface is quite simple.
> {code}
> public interface ResourceCalculator {
>   Resource adjust(Resource resource, MapWork mapWork);
>   Resource adjust(Resource resource, ReduceWork reduceWork);
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message