hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aasha Medhi (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-23746) Send task attempts async from AM to daemons
Date Sat, 08 Aug 2020 09:32:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-23746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173622#comment-17173622
] 

Aasha Medhi commented on HIVE-23746:
------------------------------------

Introduced Flaky test https://issues.apache.org/jira/browse/HIVE-24019. Please check [~mustafaiman]

> Send task attempts async from AM to daemons
> -------------------------------------------
>
>                 Key: HIVE-23746
>                 URL: https://issues.apache.org/jira/browse/HIVE-23746
>             Project: Hive
>          Issue Type: Sub-task
>          Components: llap
>            Reporter: Mustafa Iman
>            Assignee: Mustafa Iman
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> LlapTaskCommunicator uses sync client to send task attempts. There are fixed number of
communication threads (10 by default). This causes unneccessary delays when there are enough
free execution slots in daemons but they do not receive all the tasks because of this bottleneck.
LlapTaskCommunicator can use an async client to pass these tasks to daemons. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message