hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (Jira)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-7318) Possible Integer Overflow in MapTask.java
Date Tue, 19 Jan 2021 17:29:00 GMT
Keith Turner created MAPREDUCE-7318:
---------------------------------------

             Summary: Possible Integer Overflow in MapTask.java
                 Key: MAPREDUCE-7318
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7318
             Project: Hadoop Map/Reduce
          Issue Type: Bug
    Affects Versions: 3.2.2, 3.1.4, 3.3.0
            Reporter: Keith Turner


The following code may overflow when the number of reduce task is large and the MR sortmb
setting is close to 2G.  In the expression kvbuffer.length, partitions, , and APPROX_HEADER_LENGTH
are all integers.  The expression assigns to a long, but the conversion to long would occur
after the expression was evaluated and integer overflow may have occurred.

https://github.com/apache/hadoop/blob/1e877761e8dadd71effef30e592368f7fe66a61b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapred/MapTask.java#L1713



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org


Mime
View raw message