commons-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Neidhart (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MATH-1070) Incorrect rounding of float
Date Thu, 16 Jan 2014 22:47:21 GMT

    [ https://issues.apache.org/jira/browse/MATH-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13874090#comment-13874090
] 

Thomas Neidhart commented on MATH-1070:
---------------------------------------

Created issue MATH-1089 for the problem with negative zero, which has already been fixed.

> Incorrect rounding of float
> ---------------------------
>
>                 Key: MATH-1070
>                 URL: https://issues.apache.org/jira/browse/MATH-1070
>             Project: Commons Math
>          Issue Type: Bug
>    Affects Versions: 3.2
>         Environment: Windows 7, IntelliJ IDEA 10.5.4.
>            Reporter: Oleksandr Muliarevych
>            Priority: Critical
>             Fix For: 3.3
>
>
> package org.apache.commons.math3.util 
> example of usage of round functions of Precision class:
> Precision.round(0.0f, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float)0.0, 2, BigDecimal.ROUND_UP) = 0.01
> Precision.round((float) 0.0, 2) = 0.0
> Precision.round(0.0, 2, BigDecimal.ROUND_UP) = 0.0
> Seems the reason is usage of extending float to double inside round functions and getting
influence of memory trash as value.
> I think, same problem will be found at usage of other round modes.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message