hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Prasanth Jayachandran (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (HIVE-21339) LLAP: Cache hit also initializes an FS object
Date Thu, 28 Feb 2019 00:05:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Prasanth Jayachandran reassigned HIVE-21339:
--------------------------------------------

    Assignee: Prasanth Jayachandran

> LLAP: Cache hit also initializes an FS object 
> ----------------------------------------------
>
>                 Key: HIVE-21339
>                 URL: https://issues.apache.org/jira/browse/HIVE-21339
>             Project: Hive
>          Issue Type: Bug
>          Components: llap
>    Affects Versions: 4.0.0
>            Reporter: Gopal V
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: llap-cache-fs-get.png
>
>
> https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java#L214
> {code}
>     // 1. Get file metadata from cache, or create the reader and read it.
>     // Don't cache the filesystem object for now; Tez closes it and FS cache will fix
all that
>     fs = split.getPath().getFileSystem(jobConf);
>     fileKey = determineFileId(fs, split,
>         HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_CACHE_ALLOW_SYNTHETIC_FILEID),
>         HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_CACHE_DEFAULT_FS_FILE_ID),
>         !HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_IO_USE_FILEID_PATH)
>         );
> {code}
>  !llap-cache-fs-get.png! 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message