hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nita Dembla (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-19912) Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch, impacts performance
Date Fri, 15 Jun 2018 16:58:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-19912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nita Dembla updated HIVE-19912:
-------------------------------
      Assignee: Prasanth Jayachandran
    Attachment: HIVE-19912.1.patch
        Status: Patch Available  (was: Open)

> Schema evolution checks prints a log line in INFO mode for each vectorized rowbatch,
impacts performance
> --------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-19912
>                 URL: https://issues.apache.org/jira/browse/HIVE-19912
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 3.0.0
>            Reporter: Nita Dembla
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>             Fix For: 3.0.1
>
>         Attachments: HIVE-19912.1.patch
>
>
> While benchmarking query96, noticed 17K log lines printed for each vector rowbactch
>  
> In file ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
>  
> {code:java}
> @@ -2554,8 +2554,8 @@ public static TypeDescription getDesiredRowTypeDescr(Configuration
conf,
>      }
>      if (haveSchemaEvolutionProperties) {
> -      if (LOG.isInfoEnabled()) {
> -        LOG.info("Using schema evolution configuration variables schema.evolution.columns
" +
> +      if (LOG.isDebugEnabled()) {
> +        LOG.debug("Using schema evolution configuration variables schema.evolution.columns
" +
>              schemaEvolutionColumnNames.toString() +
>              " / schema.evolution.columns.types " +
>              schemaEvolutionTypeDescrs.toString() +{code}
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message