hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17426) Execution framework in hive to run tasks in parallel other than MR Tasks
Date Fri, 08 Sep 2017 21:16:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16159353#comment-16159353
] 

Lefty Leverenz commented on HIVE-17426:
---------------------------------------

Config review:  Please use newlines in the description of *hive.print.task.graph* so that
it won't all be on one line in the generated template file (hive-default.xml.template).

While you're at it, you could edit the description of *hive.repl.approx.max.load.tasks* which
was added by HIVE-16896:

bq.  Provide and approximate of the max number of tasks that should be executed in before
dynamically generating the next set of tasks. The number is an approximate as we will stop
at slightly higher number than above, the reason being some events might lead to an task increment
that would cross the above limit

Suggested edits:

bq.  Provide an approximation of the maximum number of tasks that should be executed before
dynamically generating the next set of tasks. The number is approximate as Hive will stop
at a slightly higher number, the reason being some events might lead to a task increment that
would cross the specified limit.

Trivia:  Indentation should be standardized for both configs, same as for adjacent configs.

> Execution framework in hive to run tasks in parallel other than MR Tasks
> ------------------------------------------------------------------------
>
>                 Key: HIVE-17426
>                 URL: https://issues.apache.org/jira/browse/HIVE-17426
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>    Affects Versions: 3.0.0
>            Reporter: anishek
>            Assignee: anishek
>             Fix For: 3.0.0
>
>         Attachments: HIVE-17426.0.patch, HIVE-17426.1.patch, HIVE-17426.2.patch, HIVE-17426.3.patch,
HIVE-17426.4.patch
>
>
> the execution framework currently only runs MR Tasks in parallel when {{set hive.exec.parallel=true}}.
> Allow other types of tasks to run in parallel as well to support replication scenarios
in hive. TezTask / SparkTask will still not be allowed to run in parallel.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message