hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aihua Xu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-1608) use sequencefile as the default for storing intermediate results
Date Thu, 04 Feb 2016 18:49:39 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15132774#comment-15132774
] 

Aihua Xu commented on HIVE-1608:
--------------------------------

Seems it makes sense to switch to use SequenceFile by default. It will save the space. The
newline characters in the intermediate text file are escaped, so we shouldn't have that issue
any more.

I will regenerate the baselines.

> use sequencefile as the default for storing intermediate results
> ----------------------------------------------------------------
>
>                 Key: HIVE-1608
>                 URL: https://issues.apache.org/jira/browse/HIVE-1608
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.7.0
>            Reporter: Namit Jain
>            Assignee: Brock Noland
>         Attachments: HIVE-1608.1.patch, HIVE-1608.patch
>
>
> The only argument for having a text file for storing intermediate results seems to be
better debuggability.
> But, tailing a sequence file is possible, and it should be more space efficient



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message