hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <>
Subject [jira] [Commented] (HIVE-11527) bypass HiveServer2 thrift interface for query results
Date Wed, 22 Jun 2016 22:01:16 GMT


Thejas M Nair commented on HIVE-11527:

[~tasanuma0829] I think it makes sense to explore if we can extend typeDesc to encode the
fully information for complex types. Otherwise, we have duplicate information being sent.
([~prasadm] [~cwsteinbach] please chime in if you have tried that ).

The serliazation format is hardcoded in this case. If we use a single serde format, using
LazyBinarySerDe instead of LazySimpleSerde is likely to be more performant IMO. [~gopalv]
What are your thoughts on that ?

> bypass HiveServer2 thrift interface for query results
> -----------------------------------------------------
>                 Key: HIVE-11527
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>            Reporter: Sergey Shelukhin
>            Assignee: Takanobu Asanuma
>         Attachments: HIVE-11527.10.patch, HIVE-11527.11.patch, HIVE-11527.WIP.patch
> Right now, HS2 reads query results and returns them to the caller via its thrift API.
> There should be an option for HS2 to return some pointer to results (an HDFS link?) and
for the user to read the results directly off HDFS inside the cluster, or via something like
WebHDFS outside the cluster
> Review board link:

This message was sent by Atlassian JIRA

View raw message