From issues-return-197109-apmail-hive-issues-archive=hive.apache.org@hive.apache.org Tue Aug 4 07:22:02 2020 Return-Path: X-Original-To: apmail-hive-issues-archive@locus.apache.org Delivered-To: apmail-hive-issues-archive@locus.apache.org Received: from mailroute1-lw-us.apache.org (mailroute1-lw-us.apache.org [207.244.88.153]) by minotaur.apache.org (Postfix) with ESMTP id 1A9C01A376 for ; Tue, 4 Aug 2020 07:22:02 +0000 (UTC) Received: from mail.apache.org (localhost [127.0.0.1]) by mailroute1-lw-us.apache.org (ASF Mail Server at mailroute1-lw-us.apache.org) with SMTP id C4ADB12431F for ; Tue, 4 Aug 2020 07:22:01 +0000 (UTC) Received: (qmail 16729 invoked by uid 500); 4 Aug 2020 07:22:01 -0000 Delivered-To: apmail-hive-issues-archive@hive.apache.org Received: (qmail 16697 invoked by uid 500); 4 Aug 2020 07:22:01 -0000 Mailing-List: contact issues-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list issues@hive.apache.org Received: (qmail 16682 invoked by uid 99); 4 Aug 2020 07:22:01 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2020 07:22:01 +0000 Received: from jira-he-de.apache.org (static.172.67.40.188.clients.your-server.de [188.40.67.172]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id D4077434A1 for ; Tue, 4 Aug 2020 07:22:00 +0000 (UTC) Received: from jira-he-de.apache.org (localhost.localdomain [127.0.0.1]) by jira-he-de.apache.org (ASF Mail Server at jira-he-de.apache.org) with ESMTP id 541BD7803DE for ; Tue, 4 Aug 2020 07:22:00 +0000 (UTC) Date: Tue, 4 Aug 2020 07:22:00 +0000 (UTC) From: "ASF GitHub Bot (Jira)" To: issues@hive.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Work logged] (HIVE-23959) Provide an option to wipe out column stats for partitioned tables in case of column removal MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-23959?focusedWorklogId=466075&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-466075 ] ASF GitHub Bot logged work on HIVE-23959: ----------------------------------------- Author: ASF GitHub Bot Created on: 04/Aug/20 07:21 Start Date: 04/Aug/20 07:21 Worklog Time Spent: 10m Work Description: pvary commented on a change in pull request #1341: URL: https://github.com/apache/hive/pull/1341#discussion_r464850208 ########## File path: standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java ########## @@ -1352,6 +1352,12 @@ public static ConfVars getMetaConf(String name) { "If both this and the metastore.dbaccess.ssl.* properties are set, then the latter properties \n" + "will overwrite what was set in the deprecated property."), + COLSTATS_RETAIN_ON_COLUMN_REMOVAL("metastore.colstats.retain.on.column.removal", + "hive.metastore.colstats.retain.on.column.removal", true, + "Wether to retain column statistics during column removals in partitioned tables - disabling this " Review comment: nit: Whether? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: users@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 466075) Time Spent: 1h 20m (was: 1h 10m) > Provide an option to wipe out column stats for partitioned tables in case of column removal > ------------------------------------------------------------------------------------------- > > Key: HIVE-23959 > URL: https://issues.apache.org/jira/browse/HIVE-23959 > Project: Hive > Issue Type: Improvement > Reporter: Zoltan Haindrich > Assignee: Zoltan Haindrich > Priority: Major > Labels: pull-request-available > Time Spent: 1h 20m > Remaining Estimate: 0h > > in case of column removal / replacement - an update for each partition is neccessary; which could take a while. > goal here is to provide an option to switch to the bulk removal of column statistics instead of working hard to retain as much as possible from the old stats. -- This message was sent by Atlassian Jira (v8.3.4#803005)