hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Rajkumar Singh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-21342) Analyze compute stats for column leave behind staging dir on hdfs
Date Thu, 28 Feb 2019 06:19:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Rajkumar Singh updated HIVE-21342:
----------------------------------
    Attachment: HIVE-21342.patch
        Status: Patch Available  (was: In Progress)

> Analyze compute stats for column leave behind staging dir on hdfs
> -----------------------------------------------------------------
>
>                 Key: HIVE-21342
>                 URL: https://issues.apache.org/jira/browse/HIVE-21342
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 3.1.0
>         Environment: hive-3.1
>            Reporter: Rajkumar Singh
>            Assignee: Rajkumar Singh
>            Priority: Major
>         Attachments: HIVE-21342.patch
>
>
> staging dir cleanup does not happen for the "analyze table .. compute statistics for
columns", this leads to stale directory on hdfs.
> the problem seems to be with ColumnStatsSemanticAnalyzer which don't have hdfscleanup
set for the context.
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/parse/ColumnStatsSemanticAnalyzer.java#L310



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message