hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-13029) NVDIMM support for LLAP Cache
Date Wed, 18 May 2016 16:28:12 GMT

    [ https://issues.apache.org/jira/browse/HIVE-13029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289249#comment-15289249
] 

Sergey Shelukhin commented on HIVE-13029:
-----------------------------------------

Btw, one question I had, how is mem mapped file memory attributed by YARN? As far as I can
tell we have no control over it, right? As long as YARN doesn't see it it should be ok, otherwise
the containers might get killed.

> NVDIMM support for LLAP Cache
> -----------------------------
>
>                 Key: HIVE-13029
>                 URL: https://issues.apache.org/jira/browse/HIVE-13029
>             Project: Hive
>          Issue Type: New Feature
>          Components: llap
>    Affects Versions: 2.1.0
>            Reporter: Gopal V
>            Assignee: Gopal V
>            Priority: Critical
>         Attachments: HIVE-13029.1.patch, HIVE-13029.2.patch
>
>
> LLAP cache has been designed so that the cache can be offloaded easily to a pmem API
without restart coherence.
> The tricky part about NVDIMMs are restart coherence, while most of the cache gains can
be obtained without keeping state across refreshes, since LLAP is not the system of record,
HDFS is.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message