hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vihang Karajgaonkar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20363) Use integer constants for frequently used serde classes.
Date Thu, 16 Aug 2018 17:37:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16582858#comment-16582858
] 

Vihang Karajgaonkar commented on HIVE-20363:
--------------------------------------------

I think it would be good to give some motivation as to why we are making this change and the
results of this improvement in the Jira description since this change is possibly going to
affect almost all the table entries at the schema level.

> Use integer constants for frequently used serde classes.
> --------------------------------------------------------
>
>                 Key: HIVE-20363
>                 URL: https://issues.apache.org/jira/browse/HIVE-20363
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore, Standalone Metastore
>            Reporter: Anurag Mantripragada
>            Assignee: Anurag Mantripragada
>            Priority: Major
>
> Serde libraries are stored as fully qualified class names which are long strings, we
can get improvements in I/O and storage if we store integer constants for frequently used
serde classes in the backend DB.
> For example:
> {code:java}
> org.apache.hadoop.hive.serde2.avro.AvroSerDe"---> 1
> parquet.hive.serde.ParquetHiveSerDe" ---> 2
> ...{code}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message