hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <>
Subject [jira] [Commented] (HIVE-10474) LLAP: investigate why TPCH Q1 1k is slow
Date Fri, 24 Apr 2015 16:07:38 GMT


Sergey Shelukhin commented on HIVE-10474:

When I was running, I only saw this pattern with IO not enabled. Note that each 6-query run
is a separate LLAP cluster

> LLAP: investigate why TPCH Q1 1k is slow
> ----------------------------------------
>                 Key: HIVE-10474
>                 URL:
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>         Attachments: llap-gc-pauses.png
> While most queries run faster in LLAP than just Tez with container reuse, TPCH Q1 is
much slower.
> On my run, on tez with container reuse (current default LLAP configuration but mode ==
container and no daemons running)  runs 2-6 (out of 6 consecutive runs in the same session)
finished in 25.5sec average; with 16 LLAP daemons in default config the average was 35.5sec;
same w/o IO elevator (to rule out its impact) it took 59.7sec w/strange distribution (later
runs were slower than earlier runs, still, fastest run was 49.5sec).
> So excluding IO elevator it's more than 2x degradation.
> We need to figure out why this is happening. Is it just slot discrepancy? Regardless,
this needs to be addressed.

This message was sent by Atlassian JIRA

View raw message