hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20648) LLAP: Vector group by operator should use memory per executor
Date Tue, 02 Oct 2018 12:17:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635375#comment-16635375
] 

Hive QA commented on HIVE-20648:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12942074/HIVE-20648.3.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 15005 tests executed
*Failed tests:*
{noformat}
TestMiniDruidCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=195)
	[druidmini_masking.q,druidmini_test1.q,druidkafkamini_basic.q,druidmini_joins.q,druid_timestamptz.q]
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_dynamic_partition_pruning]
(batchId=188)
org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[vector_outer_join5]
(batchId=191)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/14176/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/14176/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-14176/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12942074 - PreCommit-HIVE-Build

> LLAP: Vector group by operator should use memory per executor
> -------------------------------------------------------------
>
>                 Key: HIVE-20648
>                 URL: https://issues.apache.org/jira/browse/HIVE-20648
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 4.0.0, 3.2.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: HIVE-20648.1.patch, HIVE-20648.2.patch, HIVE-20648.3.patch
>
>
> HIVE-15503 treatment has to be applied for vector group by operator as well. Vector group
by currently uses MemoryMX bean to get heap usage and heap max memory which will not work
for LLAP. Instead it should use memory per executor as upper bound to make flush decision.  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message