hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vihang Karajgaonkar (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-20168) ReduceSinkOperator Logging Hidden
Date Mon, 30 Jul 2018 17:48:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-20168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vihang Karajgaonkar updated HIVE-20168:
---------------------------------------
       Resolution: Fixed
    Fix Version/s: 3.2.0
                   4.0.0
           Status: Resolved  (was: Patch Available)

> ReduceSinkOperator Logging Hidden
> ---------------------------------
>
>                 Key: HIVE-20168
>                 URL: https://issues.apache.org/jira/browse/HIVE-20168
>             Project: Hive
>          Issue Type: Bug
>          Components: Operators
>    Affects Versions: 3.0.0, 4.0.0
>            Reporter: BELUGA BEHR
>            Assignee: Bharathkrishna Guruvayoor Murali
>            Priority: Minor
>              Labels: newbie, noob
>             Fix For: 4.0.0, 3.2.0
>
>         Attachments: HIVE-20168.1.patch, HIVE-20168.2.patch, HIVE-20168.3.patch
>
>
> [https://github.com/apache/hive/blob/ac6b2a3fb195916e22b2e5f465add2ffbcdc7430/ql/src/java/org/apache/hadoop/hive/ql/exec/ReduceSinkOperator.java]
>  
> {code:java}
> if (LOG.isTraceEnabled()) {
>   if (numRows == cntr) {
>     cntr = logEveryNRows == 0 ? cntr * 10 : numRows + logEveryNRows;
>     if (cntr < 0 || numRows < 0) {
>       cntr = 0;
>       numRows = 1;
>     }
>     LOG.info(toString() + ": records written - " + numRows);
>   }
> }
> ...
> if (LOG.isTraceEnabled()) {
>   LOG.info(toString() + ": records written - " + numRows);
> }
> {code}
> There are logging guards here checking for TRACE level debugging but the logging is actually
INFO.  This is important logging for detecting data skew.  Please change guards to check for
INFO... or I would prefer that the guards are removed altogether since it's very rare that
a service is running with only WARN level logging.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message