hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <>
Subject [jira] [Commented] (HIVE-20247) cleanup issues in LLAP IO after cache OOM
Date Fri, 27 Jul 2018 13:12:00 GMT


Hive QA commented on HIVE-20247:

Here are the results of testing the latest attachment:

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results:
Console output:
Test logs:

Executing org.apache.hive.ptest.execution.TestCheckPhase
Tests exited with: Exception: Patch URL
was found in seen patch url's cache and a test was probably run already on it. Aborting...

This message is automatically generated.

ATTACHMENT ID: 12933298 - PreCommit-HIVE-Build

> cleanup issues in LLAP IO after cache OOM
> -----------------------------------------
>                 Key: HIVE-20247
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Prasanth Jayachandran
>            Assignee: Sergey Shelukhin
>            Priority: Major
>         Attachments: HIVE-20247.01.patch, HIVE-20247.patch
> LLAP IO creates unallocated buffer objects inside the read-related data structures, then
allocates them in bulk, then decompresses into them and increfs them.
> If allocate or decompress steps fail, it's hard for the higher-level cleanup to tell
what the state of the buffers in the read-related structures is - they may be unallocated,
allocated but not incref-ed, or incref-ed.
> Some cleanup paths only deal with the latter case, resulting in bugs.
> Moreover, currently allocator returns partial results on such error. The allocation should
be all-or-nothing.
> This only happens on one path, others allocate and use buffers in a single place.

This message was sent by Atlassian JIRA

View raw message