hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19875) increase LLAP IO queue size for perf
Date Tue, 12 Jun 2018 23:49:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16510402#comment-16510402
] 

Sergey Shelukhin commented on HIVE-19875:
-----------------------------------------

Nit: the config value could be obtained once.
Can be fixed on commit, +1 pending tests

> increase LLAP IO queue size for perf
> ------------------------------------
>
>                 Key: HIVE-19875
>                 URL: https://issues.apache.org/jira/browse/HIVE-19875
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 3.1.0, 4.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: HIVE-19875.1.patch
>
>
> According to [~gopalv] queue limit has perf impact, esp. during hashtable load for mapjoin
where in the past IO used to queue up more data for processing to process.
> 1) Overall the default limit could be adjusted higher.
> 2) Depending on Decimal64 availability, the weight for decimal columns could be reduced.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message