hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gunther Hagleitner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-11518) Provide interface to adjust required resource for tez tasks
Date Sat, 22 Aug 2015 00:24:45 GMT

    [ https://issues.apache.org/jira/browse/HIVE-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14707683#comment-14707683
] 

Gunther Hagleitner commented on HIVE-11518:
-------------------------------------------

[~navis] very cool. Let me take a closer look. [~vikram.dixit]/[~t3rmin4t0r] you might be
interested too.

> Provide interface to adjust required resource for tez tasks
> -----------------------------------------------------------
>
>                 Key: HIVE-11518
>                 URL: https://issues.apache.org/jira/browse/HIVE-11518
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Navis
>            Assignee: Navis
>            Priority: Minor
>         Attachments: HIVE-11518.1.patch.txt
>
>
> Resource requirements for each tasks are varied but currently it's fixed to one value(via
hive.tez.container.size). It would be good to customize resource requirements appropriate
to expected work.
> Suggested interface is quite simple.
> {code}
> public interface ResourceCalculator {
>   Resource adjust(Resource resource, MapWork mapWork);
>   Resource adjust(Resource resource, ReduceWork reduceWork);
> }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message