hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-20419) Vectorization: Speed up VectorizationDispatcher.validateInputFormatAndSchemaEvolution() for ACIDv2
Date Sat, 18 Aug 2018 00:00:37 GMT

     [ https://issues.apache.org/jira/browse/HIVE-20419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Gopal V updated HIVE-20419:
---------------------------
    Component/s: Vectorization

> Vectorization: Speed up VectorizationDispatcher.validateInputFormatAndSchemaEvolution()
for ACIDv2
> --------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-20419
>                 URL: https://issues.apache.org/jira/browse/HIVE-20419
>             Project: Hive
>          Issue Type: Bug
>          Components: Vectorization
>            Reporter: Gopal V
>            Priority: Major
>
> With ACID table, the format and schema layouts are much more strictly controlled - the
table cannot be made of partial ORC and partial RCFile.
> This assumption can remove this loop and the slow check for schema between each partition
before vectorizing the operators - the worst-case performance is the common & correct
case, where all of them match.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message