hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10324) Hive metatool should take table_param_key to allow for changes to avro serde's schema url key
Date Sat, 18 Apr 2015 02:47:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501047#comment-14501047
] 

Lefty Leverenz commented on HIVE-10324:
---------------------------------------

Does this need documentation?

Hmm ... the Hive metatool isn't documented yet because I dropped the ball when [~ashutoshc]
and [~shreepadma] asked me to create a wiki page for it.  If somebody will give me a copy
of the --help output then I'll take care of it right away.  Or you can wait until I get Hive
installed, a long-delayed task on my TO DO list.  I tried to find the information in the code
but only had partial success.

(Also, the Fix Version should be specified above.)

> Hive metatool should take table_param_key to allow for changes to avro serde's schema
url key
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-10324
>                 URL: https://issues.apache.org/jira/browse/HIVE-10324
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 1.1.0
>            Reporter: Szehon Ho
>            Assignee: Ferdinand Xu
>         Attachments: HIVE-10324.1.patch, HIVE-10324.patch, HIVE-10324.patch.WIP
>
>
> HIVE-3443 added support to change the serdeParams from 'metatool updateLocation' command.
> However, in avro it is possible to specify the schema via the tableParams:
> {noformat}
> CREATE  TABLE `testavro`(
>   `test` string COMMENT 'from deserializer')
> ROW FORMAT SERDE 
>   'org.apache.hadoop.hive.serde2.avro.AvroSerDe' 
> STORED AS INPUTFORMAT 
>   'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' 
> OUTPUTFORMAT 
>   'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'
> TBLPROPERTIES (
>   'avro.schema.url'='hdfs://namenode:8020/tmp/test.avsc', 
>   'kite.compression.type'='snappy', 
>   'transient_lastDdlTime'='1427996456')
> {noformat}
> Hence for those tables the 'metatool updateLocation' will not help.
> This is necessary in case like upgrade the namenode to HA where the absolute paths have
changed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message