hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Ilchenko (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-20679) DDL operations on hive might create large messages for DBNotification
Date Wed, 03 Oct 2018 21:34:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-20679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16637529#comment-16637529
] 

Eugene Ilchenko commented on HIVE-20679:
----------------------------------------

Entries for tables with deep Avro schemas can get even larger. We have seen 500K entries
for a single added partition.

> DDL operations on hive might create large messages for DBNotification
> ---------------------------------------------------------------------
>
>                 Key: HIVE-20679
>                 URL: https://issues.apache.org/jira/browse/HIVE-20679
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 3.1.0
>            Reporter: anishek
>            Assignee: anishek
>            Priority: Major
>         Attachments: a.sql, b.sql
>
>
> Certain type of ddl operations might create large messages as part of DBNoitificaion,
this might lead to the rdbms throwing an error when storing the message since its size is
to large. It will also increase the footprint of the rdbms space usage. 
> We should try store compressed messages to allow handling these situations. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message